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NOTE 

Tms volume includes substantially the complete Report 
presented to the Department of Economics and to the Pres- 
ident of the University in September, 1916. A few correc- 
tions and emendations have been made at the suggestion 
of members of the Department and of the President; and 
in the interests of brevity a certain amoimt of material, 
presented in fnll in the Report, has here been represented 
by examples only, or merely referred to. Names have, of 
course, been omitted, and in some cases the numbers and 
titles of courses. A few sections of the Report have been 
revised to emphasize their general bearing rather than their 
specific application or the circumstances imder which they 
were first written. The Report is published in the convic- 
tion that the problems with which it deals, the method it 
seeks to exemplify, and the conclusions it embodies are 
properly of interest to college teachers, not only of Econom- 
ics but of other subjects, not only in Harvard College but 
in other colleges. Certainly the growing desire to render 
college curricula and college teaching more effective for 
educational ends justifies the presentation of any sincere at- 
tempt to deal comprehensively and in a scientific spirit with 
the teaching of an important college subject. 
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PREFACE 

The inspectioii of which this Report makes record is ap- 
parently without precedent. There have been investiga- 
tions of certain aspects of college teaching, and studies of 
various phases of college administration, and there have 
been collections of tests and standards for college instruc- 
tion; but never before, within the knowledge of those who 
undertook this task, has one college department tumed to 
another, even to the department professionally concemed 
with the problems of teaching, with the invitation to study 
its courses with all possible thoroughness, without limitation 
of time or other condition whatsoever, and with assurance 
of cordial welcome, support, and assistance. 

The invitation bespoke the faet, of which the whole In- 
spection has given further evidence, that the Department 
of Economics f eels a vital concem in problems of teaching, 
quite apart from its concem in Economics as a subject; and 
it implied the belief that teaching may be approached in a 
scientific attitude of mind and improved as a result of scien- 
tific study. In other words, the invitation bore witness to 
the presence and persistence in college instruction, and 
specifically in the teaching of Economics, of pedagogical 
problems not easy to solve either in the light of personal 
opinion or of unorganized and uncriticized experience. 

An inspection by coUeagues whose whole interest centers 
in such problems wås a reasonable proposal, which it was 
almost impossible not to accept. Although the Division of 
Education could not whoUy f oresee how much of the work 
would have to be done imder distractions at times almost 

•• 
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viii PREFACE 

fatal to sustained effort, it recognized fully the magnitude 
of the undertaking and saw in it an exceptional opportimity 
for the objective study of educational problems in the col- 
lege. The Division therefore applied itself to the task with 
full consciousness of its possibilities and its importance. We 
have tried to face fimdamental questions, however difficult, 
as they appeared, and to deal with them broadly. Although 
we have kBpt close to the facts secured in the course of the 
Inspection, we have not sought to escape from consideration 
of situations and issues with which all college teachers are 
concemed. 

We beg to express to the members of the Economics De- 
partment our appreciation of their interest and assistance. 
Professor Bnllock, as Chairman of the Department, and 
Professor Day, because of his connection with the large in- 
troductory course, have been most burdened with our re- 
quests for information and help, and we are especially in- 
debted to them for their constant and imgrudging co- 
operation. 

The Inspection has been the work of all the present mem- 
bers of the Division of Education, as well as two former 
members: Dr. F. W. Ballou, now Assistant Superintendent 
of Schools in Boston, and Mr. D. H. Fletcher, '99, now 
Headmaster of the Detroit University School. Without 
the highly competent assistance of Dr. Alfred Johnson, '98, 
the large tables simmiarizing the questionnaires could not 
have been completed, and the subsequent discussion of them 
owes much to Mr. Roy Kelly, A.M., '16. In the production 
and interpretation of charts and tables we have had valuable 
help from Mr. E. A. Shaw, A.M., '16, Mr. L. G. Burgevin, 
'15, Miss Eleanor Abbott, Mr. L. P. Damon, A.M., '16, Mr. 
E. A. Lincoln, ^13, Mr. R. P. Currier, ^12, Mr. C. R. Small, 
'09, and Mr. H. A Sturgis. 

The Division of Education presents this Report to the 
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Department of Economics and to the President of the Uni- 
versity without expectation — as perhaps need hardly be 
remarked - that k wiU offer fin/solutions for the many 
and important problems which present themselves in the 
teaching of Economics at Harvard. We have made every 
effort, however, to provide an adequate basis of faet for the 
study of those questions we felt competent to consider, and 
to discuss them comprehensively. It goes without saying 
that we shall take the most genuine interest in further dis- 
cussions or inqniries conceming any of the facts or conclu- 
sions presented in this Report. 

Paul H. Hanus, 
George E. Johnson, 
Ernest C. Moore, 
Walter F. Dearborn, 
Alexander J. Inglis, 
John M. Brewer, 
Henry W. Holmes, 

ChairnuMu 
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THE TEACHING OF ECONOMICS 
IN HARVARD UNIVERSITY 

CHAPTER I 

THE INSPECTION AS A WHOLE 

I. CONDUCT or THE InSPECTION 

The invitation to undertake the Inspection was presented 
and accepted in October, 191 2, but no work of importance 
conld be undertaken until 19 13, owing to temporary ab- 
sences of members of the Division of Education during the 
first half of that academic year. During the second half of 
the year plans for the Inspection were completed and dis- 
cussed with members of the Department of Economics and 
with President Lowell. Two of the studies presented in this 
Report were begim, and two others attempted which proved 
impossible to carry out. Chapter VII of this Report, on Mark- 
ing, and Sections I, II, III, and IV of Chapter IV, on Minor 
Quantitative Studies, are based on the work done in the 
spring of 1913. On October 29, 1913, a conference between 
the Department of Economics and the Division of Educa- 
tion was held in Dåne Hall, at which were presented a pre- 
liminary report on the studies begim the previous spring and 
the completed and revised plans for the Inspection. The 
work of the academic year 19 13-14 consisted of an inquiry 
conceming the study habits of undergraduates, reported in 
Section II of Chapter IV; an analysis of statements of aim 
by the instructors in Economics, reported in Chapter II; 

the transcription on to special cards of 3863 college records 
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4 TH^ TEACHING OF ECONOMICS 

of students (Classes 1903-13) who had taken a coxirse or 
courses in Economics; and the preparation of most of the 
charts and tables nsed in Chapter III. The visits to class- 
rooms began in the spring of 19 14 and continued during the 
succeeding academic year, 1914-15. The other work of 
that year was the preparation of the questionnaires, which 
were sent out in February and March, 1915. The academic 
year 1915-16 was spent in coUating the data supplied 
by the retums to the questionnaires and in writing the 
Report. 

At every stage of the Inspection we have foimd it pro- 
foundly interesting; but the distractions against which we 
often had to contend have lessened the satisfaction we 
should otherwise have taken in it, and in some cases have 
prevented us from completing particular studies and ex- 
periments, as the Report will indicate. If a similar investi- 
gation is ever carried on under University auspices we would 
eamestly recommend that one man, designated by the de- 
partment or conmiittee in charge of the investigation, be 
given full authority and freed from all other duties for at 
least a year. He ought to have clerical assistance and the 
cooperation of competent graduate students, as well as 
opportunity to conf er with the other members of the depart- 
ment or the conmiittee conducting the investigation. The 
whole department or conmodttee should be responsible for 
the methods and conclusions; but at least one person should 
be enabled to give to the investigation his undivided at- 
tention. 

II. AlMS 

With complete f reedom to conduct the Inspection accord- 
ing to oiu: own plans, we formulated at the outset several 
general principles which we considered, and now record, as 
sound — indeed necessary — for the guidance of such an 
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undertaking. We held, first of all, that our standpoint 
throughout should be strictly educational, and hence that 
we had no immediate concem with the ^highly important 
work of the Department or of its mdividual members in 
advancing Economics as a science or in serving the public, 
philanthropic institutions, or the business world — except, 
of course, as such service reacts on teaching. Our inquiry 
therefore kept constantly in view the only educational end 
in itself there is — the individual student; and our primary 
concem was with the undergraduate. Conceming the effects 
of instruction in Economics on the character, the com- 
petence, and the career of the student, of whatever class, we 
desired to secure the fullest information possible; and our 
second principle was that this information should constantly 
be sought in the form of verifiable and preferably quantita- 
tive records, so that our conclusions and recommendations 
might have a firm basis of faet. We did not suppose that 
all our studies could be statistical, for the data of education 
cannot always be treated statistically with the greatest 
profit; but we wished to avoid, so far as possible, either mere 
opinion based on personal observation which cannot be 
confirmed, or appeal to general principles which are still 
subject to discussion. As a corollary to this, we held that 
the Inspection should be wholly impersonal. We did not 
f eel cailed on to criticize the teaching of individual instruc- 
tors, not only because the task would have been ungrateful 
to us, but for the more technical reasons stated in the first 
section of the chapter on Method. Questions of method, 
important as they are, are not as significant in education as 
is sometimes supposed; aims are more important, and the 
general organization of means and materials also. Method 
lies rather within the art of education than within the science 
of it, and must be acquired by practice and continued super- 
vision. We felt, therefore, that our results and recommenda- 
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tions ought to be general and that data as to particular 
courses ought, if they came to us, to be tumed over to the 
Department simply for what they might be worth. 

We decided, also, not to hesitate to deal with any prob- 
lem in its most general form, provided our data justified us 
in dealing with it so. Thus the chapters on Aims, on Meth- 
ods, and on Marking all contain some discussion bearing not 
only on the teaching of Economics but on much college 
teaching in other subjects. We have tried always to keep 
to our basis of faet, if not in the form of quantitative sum- 
maries, at least in the form of analyses of actual records; 
but we have not narrowed the discussion to the teaching of 
Economics when no distinction could properiy be made be- 
tween the teaching of that subject and the teaching of others. 

Many specific recommendations we did not expect to 
make. An educational policy must be determined by those 
who have the entire body of facts in mind, and one important 
class of facts we were not, and could not be, in a position 
f ully to master — the facts, namely, of Economics as a sub- 
ject. Aims and methods in the teaching of any subject must 
be conceived in the light of socially and individually desir- 
able results in the lives of the students, and in the light of 
the opportimities offered and the limitations imposed by 
conditions, including the characteristics of the students 
themselves, their stage of advancement, and their own pur- 
poses, and including also the values inherent in the subject 
as an educational instnunent. These last we know only as 
laymen know them: and our conclusions and recommenda- 
tions are accordingly tentative, with whatever finality they 
may be expressed. They are subject to revision in the light 
of expert knowledge of Economics, being valid in their pres- 
ent form only so far as reasoning competent to the general 
educator can establish them. 
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III. WoRKiNG Plan 

The Plan approved at the conference of October 29, 1913, 
was very useful, as a basis, throughout the Inspection, but 
it was avowedly provisional and we had to depart from it in a 
number of points as the work progressed. Its arrangement 
shows, however, our general conception of the task, and its 
headings are therefore reproduced below. The Report does 
not follow the headings of the Plan because the material as 
it came in proved even more extensive than we anticipated 
and because it took shape more conveniently under other 
headings. The Report contains data or discussion, how- 
ever, on all the questions formulated in the Plan. 

Preliminary list of questions for use in the Economics 
Inspection, October 2g, igij 

A. Curricula and Student Achievement 

1. What curricula do students pursue? 

(a) Economics A only 

(b) Economics A and Middle Group courses, etc. 

2. What grades do students eam in the several courses? 

3. What growth do students show in ability to deal with eco- 
nomic problems? 

This point called for the construction of a "fundamental 
test." (See below, Ch. 4, § IV) 

B. Factors in the Choice of Curricula and in Student Achievement 

I. Selection of Courses. 

1. What are the students' aims? 

2. What guidance does the Department give them? 

II. Grades. 

1. What is the Department's standard of grading? 

2. What is the relation between the students' ages and 
their class in college and the grades they eam in this 
Department? 

3. What is the correlation of grades in Economics and 
grades in History? Government? Other subjects? 
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m. Methods. 

1. What are the advantages of inductive presentation in 
the teaching of Economics? 

2. What are the advantages and possibilities of laboratory 
and field work of a constructive kind? 

3. What are the possibilities of direct control by instructors 
of the study devoted to material to be memorized by 
students? 

IV, Aims. 

1. What aims have the members of the Department now 
in view for undergraduate instruction in Economics? 

2. What are the spedal aims of the instructors in their 
several courses? 

Two important parts of the Plan we could not carry be- 
yond their initial stages — the construction and use of a 
"fundamental test" for the measurement of growth in gen- 
eral ability to deal with economic problems, and the conduct 
of controlled experiments in method. Our proposals in both 
cases are discussed in Chapter IV. In neither case was the 
diflSiciilty inherent in the nature of the imdertaking. With 
the cooperation of Professor Day we made good begirmings 
in both. But it was impossible to continue, because nobody 
concemed could give these tasks the necessary time. Al- 
though we had hoped to deal first, by test and experiment, 
with student achievement in Economics, and later, in view 
of the results obtained, inquire into aims, methods, and 
marking, we found it imperative to go ahead with the sta- 
tistical studies, the analysis of statements of aim, visits to 
classes, and the questionnaires to students. Under other cir- 
cumstances, however, the difficulties we encountered could 
be f ully obviated by relieving investigators and staff of other 
burdensin favor of this work. Westill believein thepossibility 
and in the value of controlled experiment in college teaching 
and of the attempt to measure its results — at least in some 
subjects — by means of a fundamental test. A fimda- 
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mental test, as is elsewhere pointed out, cannot take the 
place of a course examination; but as a means of educational 
investigation it is worth taking much pains to devise and 
apply. Experiments yielding quantitative retums can be 
carried on without material injustice to the students in- 
volved and with great promise of benefit to their successors. 
Without these means of securing information about our 
work, we must still rely on data far less convincing, such as 
replies to questionnaires, or else on conjecture, opinion, and 
uncorroborated conclusions from experience. 

IV. Suggestions for Further Study 

One of the supplements to this Report consists of a list of 
questions and problems which was formulated early in the 
course of the Inspection and from which the Plan just dis- 
cussed was derived. Most of the inquiries proposed in the 
list have been made, in one way or another; but in two of the 
main fieids of inquiry there defined - as to the Staff and as 
to Costs — we did not f eel prepared to secure the necessary 
data, and in some others our data must be supplemented 
before sound conclusions can be established, We would 
therefore suggest to the Department further studies imder 
the headings given in this section, below. Other suggestions 
for study are contained here and there in the Report, in 
addition to general recommendations of policy or procedure. 
We would also recommend that the Department conduct 
experiments and inquiries to complete those reported 
(whether as merely attempted or as partly carried out) in 
Chapter IV — the experiments in Method and the project 
of a Fundamental Test; and further, that in Economics A 
and if possible in other courses, studies of marking be made 
similar to the one reported in Chapter VII. It would be 
worth while, besides, to follow up the questionnaire to stu- 
dents with specific inquiries to selected men, especially as to 
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the vocational use to which they have since been able to put 
their knowledge of Economics. 
The fieids in which we would suggest new studies are : 

I. The scope, organization, and departmental regulation of the in- 
struction, both in Economics as a whole and in its several 
branches. 

A study of the courses given in other universities would be 
a natural starting point for inquiry under this head. The 
inquiry ought to be broad enough to include the problem of 
the relation between Economics and Sodology and between 
Economics and Social Ethics. Important special studies 
might be made of the fieids covered by the several courses — 
their relationships to each other and to various forms of ac- 
tivity outside of college. The suggestion, made by the De- 
partment Committee on Courses of Instruction, that a 
uniform system of keeping lecture notes be adopted, might 
well be considered further, and broadened to cover the 
system of assigning reading and thesis subjects, recording 
written work, and providing source material and opportuni- 
ties for field work. The practicability of crediting in certain 
courses active work during the siunmer months — inves- 
tigations, apprenticeship in banks, corporations, or raihoads, 
govemment service, or service in philanthropic institutions 
— deserves careful study. Might not a sohd piece of field 
work in the summer af ter the Junior year be reasonably ac- 
cepted in place of the special Divisional examination, or of 
part of it? 

Comparison might profitably be made between the De- 
partment of Economics and other departments in the Col- 
lege: as to the number of courses offered, the instructors em- 
ployed, the students taught, concentrations and degrees with 
distinction, doctorate examinations, standards of grading. 

2. The staff — distribution of work among the members of the De- 
partment; the time spent in writing and research, conmiittee 
work, public service, and teacbing outside the College; dis- 
tribution of graduate and undergraduate teaching; criteria for 
judging the efficiency of instruction; practicable methods of 
inspection. 

3. Costs — equipment and resources; teaching; publications. 

A study of costs would involve a study of the size of classes 
and the per pupil expenditure for various courses, especially 
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for undergraduate instruction as compared with graduate 
instruction. 
4. Causes of failure and poor work, especially in advanced courses. 
A full study of the cases of D and E men, especially 
of their success in other courses and in after life, might lead 
to interesting conclusions conceming the possibility of meet- 
ing individual needs in college teaching and especially con- 
ceming the opportunities for advice and guidance in the 
choice of courses in college and of vocations afterward. 
Causes of success in college work might be studied in similar 
fashion. 

V. General Impressions from the Inspection 

The Inspection was undertaken without prepossessions, 
and this Report has not been written to support any pre- 
conceived educational poKcy ; nor does it contain any section 
advancing detailed proposals for "reform." For reasons 
already given, we must present our conclusions and sugges- 
tions with the expectation that they may be modified or 
reversed by those who have intimate knowledge, outside 
the scope of our inquiry, of an important aspect of these 
problems. Yet a few outstanding features of the whole body 
of data we have studied may be characterized in general 
terms with some hope of profit. They are veins, meta- 
phorically speaking, which nm through the statistics, lists, 
and analyses of the Report. In some piaces they are less 
prominent than in others, but to one who has dissected the 
whole mass they stand out with imdeniable cleamess. 

These features are imdoubtedly as characteristic of college 
instruction in general as of instruction in Economics. They 
imply tendencies in college teaching which spring from the 
situation in which the college teacher finds himself . In part 
they are due to tradition, in part to more concrete causes, 
such as lack of fimds, in part to difl&culties inherent in 
teaching men of college age. 

College teaching tends to present all subjects from a 
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scientific point of view: it is likely to be academic — and 
the teaching of Economics escapes neither the advantages 
nor the disadvantages of this tendency. It exponnds to 
inexperienced young men theories and masses of informa- 
tion before they have become acquainted in any personal 
way with the elementary facts, processes, and situations 
with which the subject deals. It reqnires a great deal of 
listening and reading, and very little observation, practical 
judgment, or active decision. Its issues are not significant 
at the moment : they induce efif ort to make them clear only 
for the immediate purpose of passing examinations or pre- 
senting good theses. The teaching brings students into 
touch with the activities of the world too seldom or too 
partially to permit them to relate what they are studying 
to what men are doing. Students find it hard not to make 
college stiidy a game, in which they may legitimately apply 
themselves to getting marks by studying books, examina- 
tions, and their professors, at the expense of a vital knowl- 
edge of the subject. Progress here certainly does not lie in 
the abandonment of marks, lectures, reading, section meet- 
ings, and the rest of our common machinery, but in the 
persistent effort to sharpen issues, awaken thought, and 
induce vigorous mental reaction by every means at our dis- 
posal, especially by utilizing every opportunity to bring 
students face to face with the subject as an aspect of life in 
the concrete. 

College teaching, at least in America, tends to be dis- 
connected: it is conducted by imits which are not natura! 
divisions of interest and activity in life, but are fenced oflf 
from one another for pedagogical purposes. This tendency 
the Division of History, Government, and Economics is 
already vigorously combating through its recent adoption 
of Divisional examinations and Tutorial instruction. But 
even the new scheme runs the risk of remaining artificial if 
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the Schedules it involves are made without clear reference 
to the purposes of the students who elect to f ollow them — 
without reference, that is, to the legitimate outcome of any 
Schedule in practical activity or further study. Specializa- 
tion in college ought to have some point. If the old 
elective system made the mistake of permitting college 
boys to patch their curricula together as whim or conven- 
ience might dictate, the new system may fall into the error 
of assiuning or forcing in every student a scholarly bent or 
interest which he does not possess and cannot develop. 
College teaching ought to be cathoKc enough to admit 
among the considerations on which specialization may be 
based such practical purposes as intention to enter diplo- 
matic service, medicine,military service, joumalism, business, 
or any other career . What preparation, immediate or remote, 
any given course affords for any given occupation is a matter 
for investigation or for special adjustment of the course; but 
it is injurious to insist that concentration shall be deter- 
mined solely by the artificial distinctions between subjects 
and fieids for distinction, while the ambitions of students 
and the practical possibiUties of curricula are ignored. 

College teaching tempts instructors to slight the laborious 
detail of instruction — the minutiae of method, marking, 
and the administration of requirements, the tediousness of 
conf erences, thesis reading, and the checking of results. The 
teaching of Economics probably suffers less from this tend- 
ency than the teaching of many other subjects; and our data 
suggest a general danger rather than a specific defect. The 
policy of departmental control and reasonable supervision 
already adopted by the Department is nevertheless clearly 
advisable; and both study and experiment with devices, 
methods, and policies are as clearly necessary to the estab- 
lishment of more effective systems and standards in the 
teaching of imdergraduates. 
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College teaching tends to miss the individual — to break 
the contact between teacher and pupil which makes school 
work effective in certain respects, as it often endangers its 
effectiveness in others. More money is the final solution of 
this problem, for more money means more teachers; but a 
better adjustment of the demands on individual instructors 
for teaching, administrative and conunittee work, and writ- 
ing, is also needed. The policy of expecting every college 
teacher to produce has been beneficial to many instructors 
and harmful to many students. Personal contact is the 
heart of education, and time spent in it ought never to bur- 
den a college teacher's conscience as time wasted. Advice 
as to courses, curricula, future vocations, reading, general 
conduct; discussion of problems and questions in a course 
or a subject; conferences on theses, papers, and examination 
books, both as to content and as to form and style — these 
ought to be as free to students from college teachers of every 
rank as the resources of the college can render possible. It 
is clear that the Department of Economics makes due effort 
to fulfill its obligations in this phase of teaching, and the 
Tutorial plan will doubtless prove especially valuable in this 
very respect: but the general limitation imder which all 
college instruction sufifers because there is not time for pro- 
fessors to know their students as individuals, appears in this 
investigation as it imquestionably would in any other, and 
for this particular problem the Tutorial scheme cannot, in 
the nature of the case, offer a final solution. 

Looming larger and more impressive throughout the 
Inspection appeared the conclusion that college teaching 
too often fails to reach the student. Obstacles and distrac- 
tions of many sorts prevent educative contact between 
teacher and pupil. The fimdamental problem in the College 
is the problem of individual instruction, or, if we may use a 
phrase so general as to cover the whole life of the imder- 
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graduale, the problem of individual development during 
the college years. We find no reason to despair of the coUege 
or to favor a reorganization on the Junior-College plan; nor 
do we find reason to beheve it impossible to solve this prob- 
lem m the large, urban, imiversity college. We see no single, 
simple road to a solution, but we believe that a combination 
of many measures, carefully related and sensibly admin- 
istered, may bring us as near as is himianly possible to full 
success in imdergraduate education. Two conditions, we 
are confident, are essential to any plans or efforts toward 
this end — a general willingness on the part of college teach- 
ers to study the problems of instruction, training, and disci- 
pline as carefully, as broadly, as intensively, and as objec- 
tively as they would study the problems of the subject they 
teach; and an organization of coUege work which will make 
it unnecessary for any teacher to be so overburdened by the 
number of his students, the variety of the subjects he teaches, 
administrative duties, the claims of research, or the need to 
do remimerative outside work, that he must neglect the 
individuals imder his charge. 



CHAPTER II 

AIMS 

I. Statements from Members of the Department 

OF ECONOMICS 

On August 4, 1913, the foUowing circular letter was sent to 
members of the Department of Economics: 

As a part of our survey of the work of the Department of Eco- 
nomics we are asking each instructor m Economics to formulate for 
us the aims of the courses that he gives; that is to say, we would like 
a brief but comprehensive statement of what each instructor expects 
the students to get from each of his courses. Doubtless each in- 
structor has a general aim, which is in harmony with the purpose of 
any instruction in Economics or is identical with it; but in addition 
each course also naturally represents the instructor's endeavor to 
realize a particular portion of the general aim or to cover some par- 
ticular aspect of it. In any case, we would like to know what the in- 
structor's purposes are. Will you kindly let us hear from you soon? 

Replies to this request were received from eight instruc- 
tors, and included specific statements conceming eighteen 
courses. The letters themselves may be secured by anyone 
especially interested to read them. They are not printed 
in this volume, in part because they were sent as personal 
letters without a view to publication, in part because their 
general tenor is presented and analyzed in the following 
discussion in sufficient detail to make the printing of the 
letters themselves unnecessary. Also, the replies are sum- 
marized in note i, Section V, Chapter IV. The present 
chapter gives the results of an analysis, comparison, and 
general discussion of these statements of aim. 

z6 
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The Division of Education was of course competent to 
consider only the educational aspects of the statements 
submitted, without the least assmnption of insight as to the 
bearing of particular courses on progress in Economics or 
on social issues or individual needs. The repKes were so 
evidently careful, and so dear and comprehensive, that for 
this purpose no further inquiry seemed necessary. 

II. The Place of Aims m College Teaching 

Some of the letters state or imply that the instructor had 
not previously given definite form to the aims of his courses; 
but this faet did not result in any imcertainty of statement, 
for the reason, as it would seem, that the aims thus formu- 
lated were drawn from the actual practice of the instructors. 
They appear, in other words, to be statements of direction 
in the instructors' work, rather than of ideal ends, defined in 
the light of general educational considerations. These re- 
plies (and, it may be added, the drift of testimony from the 
questionnaires and the visits) provide no evidence, therefore, 
of a consistent and clearly emmciated educational policy, 
in the light of which the aims of particular courses may be 
stated. This is imdoubtedly a condition characteristic of 
college instruction in almost every field. 

The common and heretofore possibly the wholesome 
tendency of American college instructors is to attack their 
courses first from the standpoint of the subject, and only 
later consciously to adjust them for use strictly as educa- 
tional instnunents. No teaching, however, can be com- 
pletely and permanently successful, as teaching, without the 
recognition of definite educational objectives; and this faet 
suggests the importance of formulating aims, and of the 
discussion of aims in department meetings. Certain diver- 
sities in these very statements are probably due in part to 
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the faet that discussion of educational aims and values is 
still so unusual in departmental and facnlty meetings that 
there is among college teachers no clear agreement as to the 
terms, general conceptions, or particular categories in which 
such discussion can best proceed. In so far as this is true, 
it suggests the value of making the discussion of such state- 
ments as these the order of business for a series of depart- 
mental conferences. 

This suggestion is exactly in line with the noteworthy 
advance made by the Department of Economics in its votes 
separatmg graduate and undergraduate instruction and plac- 
ing the latter imder departmental control. The recent regu- 
lations conceming a general examination for students who 
concentrate in the Division of ffistory, Government, and 
Economics look in the same direction — toward imity of 
educational eff ort. If undergraduate teaching is to be made 
generally effective, college instructors must submit to some 
limitation of individual f reedom — a limitation which need 
not be autocratic, indeed cannot become autocratic, so long 
as it is effected by open discussion. In Harvard College, 
the control of undergraduate courses through the submis- 
sion, for departmental discussion, of outlines covering aims, 
general methods, and requirements of reading, theses, and 
other work, is a policy as desirable as it is imusual. The 
visiting of classes by departmental committees chosen for 
the purpose may also be made of incalculable value to in- 
structors. No instructor genuinely mterested in the edu- 
cational effects of his work will object to submitting his 
plans, in detail, to a department meeting, nor to subsequent 
visits by his colleagues and frank discussion of the entire 
conduct of his work. 
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III. Analysis or Statements by Members or the 

Department 

The aims here under consideration may be analyzed and 
grouped as foUows: In courses which cover many facts and 
principles variously interrelated, the goveming aim is usu- 
ally the presentation of a systematic survey of the field. This 
presentation is of ten determined by a point of view which 
the students are expected to acquire even if they f orget much 
of the detail of the lectures and reading. In such courses 
there is also general agreement on traming m assembling 
facts, analyzing them, and reasoning from them (e. g., Eco- 
nomics A, 4a, 4b, 6a, 2a, 2b, 3, i, 5, 14, 31).^ Courses in 
which a general conception is dominant find their chief pur- 
pose in the analysis and clarification of this conception and 
in training the students to apply it to concrete cases (e. g., 
Economics 8, 7, 9). Certain courses involve training in a 
technical method of dealing with facts (Economics i, 9). 
Minor but important aims are given in certain cases: e. g., to 
famiUarize students with the literature of the subject (Eco- 
nomics II, I, 14, 31); to present selected problems and to 
provide training in scientific methods of dealing with them 
(Economics 33, 5, 14, 31, 2oe); to train in careful and critical 
reading (Economics 14, 31). The stimulation of public 
spirit is stated as a definite aim in Economics A, 4a, 6a, and 
3. General moral discipline through work is given as an aim 

* The pamphlet in which these courses are described will be sent on request by 
the Publication OflSce of the University, 2 University Hall, Cambridge, Mass. 
As the numbers attached to courses are sometimes changed from year to year, it 
is necessary to note that the numbers here given refer to courses offered in 19 13-14. 
The general argument of the chapter is not affected, however, by such minor 
changes as have since been made, and all but a very few of the nimibers used 
designate the same courses now (19 17) as in 19 13-14. The only substantial change 
in courses since 19 13-14 consists in the withdrawal of Economics 9, the course in 
AccoufUingf and the substitution therefor of a half-course in Accountingf nimibered 
la and designed specifically for undergraduates. Course i, in Statistics, becomes ib. 
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in Economics 4a, 4b, 6a, i, and 3. To improve the written 
EngKsh of graduale students is given as an aim in Economics 
2oe. 

This analysis yields the foUowing somewhat loose correla- 
tion of aims: 

1. To survey the subject for a comprehensive and systematic view 
of the field to be covered. 

(a) To familiarize the students with the literature of the 
subject. 

(b) To present with special care selected illustrative problems. 
{c) To give the students insight into modem economic con- 

ditions and problems. 

2. To train the students in methods of study and thought appro- 
priate to the subject. 

(a) To train the students to deal scientifically with concrete 

problems of a special sort. 
(6) To train the students in a technical method which the 

subject involves. 

(c) To train the students in the careful reading of selected 
books. 

{d) To analyze a general conception and induce dear think- 
ing in terms of that conception. 

3. To stimulate public spirit. 

4. To give general moral disdpline through work. 

This grouping may do violence to some of thé aims as 
stated, and it is at best but an arrangement suggested by the 
statements, not contained in them; yet it is probably fairly 
representative of their main trends. The first group of aims 
centers in the idea of presenting the facts and principles in 
the field covered by the courses; the second, in the idea of 
training the students to deal efifectively with those facts and 
principles. These two groups are correlative, and together 
they cover by far the greater nimiber of the stated purposes 
of the courses. The third aim is mentioned or implied sav- 
eral times, but apparently as an aim to be realized through 
the general conduct of the courses rather than as a dominat- 
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ing purpose for which the material of the courses is organized 
and the methods chosen. The fourth aim is an aim com- 
mon to all good college instruction. Both the third and the 
fourth aims depend for their realization, in any case, less 
on choice of materials and methods than on the personal 
attitude and influence of the instructor — on his power to 
inspire, enlighten, and guide; on his insistence on standards, 
fairness in marking, and ability to meet individual needs in 
assigning work; and on similar capacities and habits of 
teaching. 

It may fairly be said that the statements, as a group, 
show a tendency to derive the purposes of instruction from 
the material of the courses. That is, they convey the im- 
pression that the work is organized primarily to cover the 
field, never, to be sure, without reference to the uses of 
knowledge, insight, and technical skill, but without ruling 
interest in the situations and relatipnships in which the 
student will find himself outside of college. The faet that 
the student is to be an active participant in economic life 
is not ignored; but the main picture of the student sug- 
gested by the statements is a picture of one whose need is 
first of all for systematic or scientific knowledge. There is 
no lack of reference to the student, nor to the qualifications 
he must have to be successful in the work of the courses. 
There is less reference to the question, What will he use his 
achievement in the courses for? 

This condition might suggest a superficial arraignment 
of instruction in Economics as "academic," "lacking in 
practical appKcation," or "imduly scientific." Many of the 
replies to the questionnaires, both graduate and imder- 
graduate, would support some such treatment of the mat- 
ter; but it would obviously be an easy dismissal of what is 
in faet a f imdamental problem in college teaching. 
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IV. General Discussion 

The problem concems not single courses only, but the 
whole cumculiun of the student in the given field. This 
is the more apparent now that the Faculty has adopted the 
principles of concentration and distribution; and m the 
Division of History, Government, and Economics, since it 
has established the Divisional examination, the general 
nature of the problem cannot but be evident. The question 
is, From what point of view shall those comprehensive aims 
be stated which are to govem the conduct of the total ofifer- 
ing of undergraduate instruction m Economics? Aims in 
single courses depend on the larger purposes for which 
courses are organized into Schedules for concentration, dis- 
tribution, distinction, and, in the end, the baccalaureate 
degree. Per contra, the making of such "concentration 
Schedules" as have recently been issued by the Division of 
History, Government, and Economics calls for very careful 
scrutiny of the aims of the courses contained in them. The 
problem centers, therefore, about the use of Economics for 
imdergraduate specialization. 

The statements here imder discussion present no dominant 
standpoint and refer to no common purpose of instruction. 
Vocational application is in at least one statement (Econom- 
ics 9) the determining consideration, as in that case it is 
obviously appropriate that it should be; in other cases (e. g., 
Economics 4a, 4b, 6a) vocational application enters to a 
certain degree as a factor in the formulation of the aim: 
but it cannot be said that the courses in Economics, as a 
whole, are directed toward vocations. They are not intended 
to be courses in Business Administration, and preparation 
for special careers is evidently not considered to be their 
fimction. But there is no clear indication, either, that 
preparation for participation in political, philanthropic, and 
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govemmental activity is the dominant aim. The state- 
ment for Economics 4a, 4b, and 6a alone distingnishes ex- 
plicitly between citizenship and vocation as objectives; 
although other statements (Economics 3, 7, 8, 31) mention 
or suggest the broader social use of knowledge as a determin- 
ing factor in the formnlation of the aim. 

The commonest implication of the statements is that a 
general imderstanding of economic conditions and economic 
forces is the nltimate end to be achieved; and there are, 
of course, clear groimds for the defense of so inclusive (even 
if so indefinite) an aim. It may be said that every college 
graduate ought to comprehend the economic order in which 
he must live and work; that the imdergraduate study of 
special aspects of Economics ought to be directed primarily 
toward the deepening and unifying of that comprehension; 
and that every imdergraduate course ought therefore to be 
fimdamentally a course in the principles of Economics. In 
similar fashion, it should then be argued, every imdergrad- 
uate course in science ought to deepen and unify the general 
imderstanding of the natural order, and in that sense be a 
course in the principles of science; every course in history 
reveal with added fullness the general evolution of human 
affairs; every course in literature lead to a clearer insight into 
the nature of Letters; and so on. If this standpoint is in faet 
accepted in any given field, it connotes acceptance of a view 
of coUege education which has recently found more and 
more frequent expression — the conception, namely, that 
the final outcome of a college education should be an articu- 
late philosophy or interpretation of life, or an approach 
to it, or at least a definite advantage in the attempt to 
achieve it. 

If imdergraduate instruction is to be purely cultural, 
some such definition of culture is essential as a basis for in- 
struction and the administration of college curricula. Good 
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taste cannot be accq)ted as an adequate criterion of culture, 
nor the ability to fill one's leisnre with refined enjoyment, 
The modem conception of culture implies insight as well, 
and the organization of knowledge, interests, and capacities 
for an intelligent reaction to the demands and opportunities 
of life in a civilized commimity. Although culture must be 
distinguished from usef ulness, it is in itself supremely xisef ul ; 
but it is general, and depends on the development of no 
specialized capacity, no single power, no limited body of 
knowledge. 

It was possible once to hold that intimate acquaintance 
with the Classics could alone enable one to "see life stead- 
ily and see it whole^'; but the Classics no longer compre- 
hend even the hmnanities, to say nothing of the sciences. 
The doctrine, subsequently advanced, that formal or gen- 
eral intellectual discipline, obtained from a single subject or 
in a single field, or from a restricted curriculmn, is a possible 
or practicable result of a college education, has been sharply 
questioned, and at least in its cruder forms, disproved. 
(The statements of aim in Economics, it may be noted, are 
very nearly free from the suggestion that the student may 
obtain a discipline of mind in that subject such as to enable 
him to deal easily and adequately with every other impor- 
tant aspect of experience.) Indeed, no single study or nar- 
row group of studies is now considered sufficient to provide a 
culture comprehensive enough to result in a penetrating and 
well-balanced view of the modem world and the life of man. 
On the contrary, the dictmn most often quoted is that cul- 
ture demands "something of every thing and everything of 
something," to the end that the college graduate may in- 
terpret life at once broadly and without superficiality. 

This principle is imdoubtedly much soimder than the 
principle of formal discipline, and, sensibly applied, it may 
efifect (and in faet has already effected) very desirable re- 
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forms in the administration of the elective system. It does 
not of itself , however, coimteract a somewhat marked tend- 
ency in our instruction which is generally admitted to be 
undesirable — the tendency to deal with imdergraduate 
subjects from the point of view of the graduate specialist. 
Nor does it of itself guarantee that the courses provided for 
general or "distributive" purposes shall be sufficiently gen- 
eral. "Everything of something" does not mean that the 
imdergraduate must be brought quickly to the point of view 
of the scientific scholar; "something of everything" does 
not mean that the imdergraduate should be given imrelated 
views of many subjects, however leamed the mstruction. 
To be efifective for general culture the material of every 
course, whether elementary or advanced, should be built 
into a growing imderstanding of the whole field within which 
the course Kes. From the standpoint of culture, thus con- 
ceived, it cannot be assumed that imdergraduate "concen- 
tration" necessitates research, or that imdergraduate "dis- 
tribution" is satisfactory if in the study of any subject in 
any "group" the student may escape without a general and 
related view of the courses he selects. If, therefore, this 
general aim of college instruction is to be accepted and 
worked out to its logicai conclusions, imdergraduate courses 
in any field ought, it would seem, to be organically related 
so as to strengthen and deepen the student's general grasp 
of that field, and instruction in every course ought to be in 
some measure broadly interpretative of the whole subject; 
furthermore, in every "group," Schedules of related general 
courses for "distributive" use ought to be arranged, and the 
instruction in those courses ought to include some efifort to 
reveal the relations of the departments of knowledge in that 
group and of that group to other groups. The statements 
of aim in the Economics courses do not show the results of 
concerted efifort to work out in this or in some other way the 
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cultural purpose on which they seem to be based, althoiigh 
the new requirements for concentration in the Division of 
History, Government, and Economics, and the requirements 
for the several degrees with distinction in this division are 
important steps toward that end. 

In Economics itself, however, it may be supposed that 
the purely cultural aim cannot be strictly adhered to, at 
least in courses designed chiefly for concentration. De- 
parture from that aim is in faet indicated in the vocational 
reference of several of the statements and in the faet that 
direct social applications of a decidedly practical charac- 
ter are also often in view. Indeed, these statements (and 
a glance at the titles of Economics courses in the Elective 
Pamphlet) bring home the conviction that the purely cul- 
tural aim is too indefinite to be accepted as the complete and 
sufficient purpose of a college education in which such a 
subject as Economics is to have any considerable part. In- 
struction in Economics for purely cultural purposes cannot, 
it would seem, be adequate, even for imdergraduate ends, 
in a imiversity college. Direct preparation both for voca- 
tion and for general social service would appear also properly 
to enter as a factor in the aims of instruction. 

This statement has no reference to the obvious desirability 
of relating instruction in Economics to actual economic 
problems, simply as a matter of method. Many of the re- 
plies to the questionnaires show that such reference is de- 
sirable, although not always attempted. It is a principle 
of teaching now generally accepted that, other things equal, 
the best way to begin the teaching of any subject is to bring 
the student face to face with concrete problems which cannot 
be satisfactorily solved except through study of that subject. 
Continuous touch with the concrete is, furthermore, an 
advantage in leaming which is usuaUy worth great pains to 
secure. But direct preparation for dealing with practical 
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problems demands more than this. The use of preliminary 
problems in the section meetings of Economics A has aroused 
interest, engendered a new motive for leaming, and given 
point to the class discussions; but it has not supplied the 
necessary conditions (in that course, to be sure, not requisite 
conditions) for practical preparation. Preparation for work 
of any importance or difficulty demands intensive study of 
actual problems of the work and a method that closely ap- 
proximates (or better, that includes) practical experience. 
Theoretical imderstanding becomes merely a half-way stage 
in progress toward practical efficiency. In fine, vocational 
or other concretely applicable preparation is not merely 
study, but training. 

The measure in which such training should be made the 
aim of any course, or of any part of any course, in Econom- 
ics, it is not within the province of laymen in that subject to 
discuss. By what methods, in what courses, and imder what 
conditions practical aims shall be realized in actual instruc- 
tion only the expert in the field can determine. The sole 
point here in question is recognition of the students' prac- 
tical purposes and the efifort to satisfy them in such ways 
as are appropriate and possible. At present no statements 
of aim and no annoimcements of courses even imply their 
existence, much less describe methods designed to meet them. 
The layman can only suggest that use of such methods is de- 
sirable, on general educational groimds, for most students 
who make Economics their major study. For specialization 
in this field cannot commonly be considered complete with- 
out it; and specialization in college particularly demands it, 
since college concentration is usually imdertaken not for the 
purpose of preparing to teach, but rather for participation in 
the afifairs of govemment, philanthropy, or business. Even 
the prospective Ph.D. ought, it may be supposed, to have 
some directly practical training; but the prospective Ph.D. 
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is but one in twenty ^ of those who concentrate in Econom- 
ics. The rest are to be workers in other fieids. Their educa- 
tion in Economics would seem to be incomplete iinless it 
leads to the beginnings of practical power in addition to 
general understanding. 

It may be said that the Business School is the place in 
which such power should be developed; and the general 
principle may be advanced that all vocational and other 
practical training should be graduate training, undergrad- 
uate concentration being reserved wholly for intensive study 
under purely cultural ideals, or for the purposes of pure 
scholarship. (The faet that only a few college men can 
afford Business School training does not affect the fimda- 
mental question, although it may long have administrative 
importance.) But complete preparation for a professional 
career may readily be assigned to graduate schools, yet the 
permanent question here at issue remain imdecided. For 
there are reasons for doubting the wisdom of a policy which 
makes pure scholarship the dominant aim of college concen- 
tration in every field and for every student. Concentration 
in such a subject as Comparative Literatiure favors, if it 
does not actually necessitate, the ideal of pure scholarship ; 
but in Economics, as in other social sciences, the imderlying 
reference is so intensely practical that a curriculum of six 
courses without the saving element of practical training 
must of ten make for remoteness and imreality. The desire 
to take part in the work of the world is strong in normal 
college men. To be sure, a decided intellectual interest 
may in many cases be a better basis for concentration 
than a weak or vague vocational or social piupose; in 

^ Based on actnal count of Harvard graduales retuming for advanced study 
in Economics. Of 460 Harvard undergradiiates concentrating in Economics dur- 
ing the period 1913-17 not one has finally received his Ph.D. in Economics from 
Harvard University, although 16 have undertaken some gradiiate work and a few 
more will doubtless do so nezt year (191 7-18). 
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other cases the impulse toward participation in active life 
may be satisfied by student enterprises, concentration serv- 
ing to engage such purely scholarly interest as the student 
may have or acquire; and possibly concentration in Econom- 
ics may thus in some cases be made to minister to purely 
scholarly interest, or to feed a specific intellectual appetite: 
but it would seem safer to admit that its natural relation 
is with practical purposes, vocational or social. The choice 
of this field commonly means that the student intends to at- 
tack economic problems as a part of his life work, either in 
his vocation or in other social activities. If he has no such 
intention, it may be doubted that he is acting wisely to 
specialize in so practical a science; his spedalization, in 
that case, ought at any rate to be determined with care. If 
his intention is clear, or becomes so, his specialization, it 
may be contended, ought to include, perhaps to culminate 
in, direct practical training. 

This argimient is based on the conviction that a college 
education which results in culture alone — that general 
imderstanding of life which makes leisure significant and 
holds all interests and activities in balance — is for many 
students inadequate, perhaps indeed impossible: it seeks to 
justify actual preparation for specific duties and obligations 
as an important element in many college curricula. But it 
does not support the claim that the college should train 
for professions, or that every student should be forced to 
choose one course which gives direct training for special 
activities. Its immediate object is to present the importance 
of vocational and other strictly practical aims in some parts 
of college instruction in Economics, especially in some of the 
courses that are meantprimarily for concentration. Whether 
any changes in the instruction now offered, and what changes, 
the acceptance of this conclusion would involve, the Divi- 
sion of Education is naturally quite incompetent to con- 
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sider: the question here at issue, although it involves the 
problem of adopting methods of practical training, is in it- 
self solely a question of aims. It is a question, however, not 
only of aims in any particular course, but even more largely 
of aims in planning student curricula, and specificaUy, curric- 
ula for concentration. 

Concentration is, indeed, the rock in the way of accept- 
ing pure culture as an organizing principle in the teaching 
of Economics. It is easy to see that Economics A, as an 
introductory survey of the subject, chosen in large part by 
men who do not intend to concentrate in Economics, may 
well take but little accoimt of specific vocational or other 
practical purposes. However necessary it may be to con- 
sider such purposes in organizing sections and directing 
students' work, the instruction itself must doubtless be 
occupied with the task of presenting contemporary economic 
organization and its major problems for the sake of deter- 
mining attitudes, training students to think in economic 
terms, and clarifying the relation of Economics to other fieids. 
Economic history must obviously be taught from a similar 
point of view. Perhaps this point of view is essential in 
other courses. The course in Accoimting seems to be the 
only course in which it would seem clear, even to the layman, 
that the cultural purpose would be wholly out of keeping and 
practical training the only natural character of the work. 
The only generalization the layman may safely venture is 
that the intentions of the students admitted to the course — 
and hence, fxmdamentally, the student purposes the course 
is designed to serve — should be the determining factor in 
the definition of its aims and accordingly in the assignment 
of its place in student curricula. (The intentions of students 
cannot be accepted, to be sure, in the crude and half-formed 
State in which students themselves often hold them: the 
purposes of youth need modification and reformulation if 
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they are to be taken into account in providing conrses; yet 
they must still remain our chief reliance in the organization 
of curricula.) In courses chosen for distribution or intended 
to serve as beginnings in concentration, the cultural aim 
may be appropriately dominant, and methods need ap- 
proach those of practical training only in so far as good 
teaching demands it and conditions permit. In some courses 
designed for concentration (e. g., the middle-group course 
in Economic Theory) the cultural purpose is apparently 
prescribed by the subject. To what extent vocational and 
other practical aims may be kept in view in other courses 
for concentration would seem to depend on the factor men- 
tioned — the purposes (properly interpreted) of the students 
admitted to the course. 

Among these purposes vocational and social-service aims 
are surely of great importance. If they exist, they ought to 
be known; if they do not exist, the student's curriculum of 
concentration ought to be affected by that faet. To urge a 
student to ignore them or thrust them aside in choosing his 
concentration would seem to be justifiable only if he has also 
a strong scholarly taste or interest and can serve his practical 
purpose by a "minor concentration" in his "free" courses. 
The problem is at bottom a problem of educational guid- 
ance. The aims of courses ought to be stated in terms of 
effort to meet the needs of students; descriptions of courses 
framed with explicit imderstanding as to the student pur- 
poses the courses are intended to serve; instruction guided 
by fuU possession of all available data as to students' Out- 
look, interests, and intentions. 

The Division of Education recognizes the faet that the 
new Schedules for concentration in Economics may well 
have been framed according to principles determined af ter 
fuU consideration (perhaps, of course, consideration re- 
sulting in views adverse to those here expressed) of the issues 
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presented in this chapter. The chapter is written without 
other data in view than those submitted in the statements 
of aim and those supplied by the pamphlets and Communi- 
cations of the Department. If any part of it offers sugges- 
tion for profitable discussion by the Department, the faet 
that the rest is mappKcable wiU be of smaU moment. 

Supplementary Note 

This chapter inevitably suggests the whole problem of under- 
graduate traiaiag for the professions and the meaning of the bach- 
elor's degree. In its present solution of this problem the University 
has adopted a policy in many respects liberal: no single subject (ex- 
cept for a fundamental course in English) is required for the degree, 
and no distinction exists between the A.B. and the S.B., except the 
requirement of admission Latin of candidates for the degree in Arts. 
The required English course may be "anticipated" in the admission 
examinations, and it is not impossible that the argument for a siagle 
bachelor's degree (the A.B.), without reference to Latin, may even- 
tually prevail; so that in time any student may secure the baccalau- 
reate degree in Harvard College on a course defined, from entrance 
to secondary school through the period of undergraduate training, 
only by broad rules for the selection and organization of studies. In 
one respect, however, the University has been more conservative as 
to the bachelor 's degree than many other American institutions: it 
has refused to count toward the degree any professional courses. The 
most notable present exception to this rule is the counting of a few 
strictly professional courses for teachers — e.g., Education 9, the 
course for supervised practice in class-room instruction; and it is 
now proposed that a Graduate School of Education shaU be estab- 
lished to take over as soon as possible all work in this field. 

The ideal of a non-professional undergraduate course is dear, and 
the Division of Education desires to take no stand against it. It is 
imdoubtedly advisable for many institutions to begin professional 
training with the junior year in college or even earlier; but it would 
seem equally advisable for some to maintain the f ull course of liberal 
studies for the A.B., without admixture of strictly professional work. 
For those who can afford the time — it has been amply proved that 
entrance to college a year or even two years before the common age 
of entrance is both safe and advantageous — the full "liberal" course 
in arts provides a highly desirable opportimity for the maturing of 
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general interests, attitudes, and views, for adventure in scholarship, 
and for the definition of practical and social purposes. It is only for 
this last phase of the whole opportunity we would here contend. 
College work in subjects with a practicai trend and Outlook ought 
finally, even in Harvard, to take for many students a practical tum, — 
which means, not that the student should be brought suddaily 
under the full control of vocational ideals, as if he had entered a 
professional school, or that vocational training be made the major 
aim of his upper-dass courses, but that his vocational purpose be 
recognized in his choice of courses and Schedules, and the practical 
usefulness of certain parts of his instruction frankly avowed. 
After certain general coiu^es, taught for purely cultural purposes, 
should come Schedules of courses leading toward entrance into the 
purely professional work of the graduate schools or bearing on the 
work of the occupation itself. Concentration according to such 
Schedules should be permitted as freely as concentration in a single 
subject or a set of academically related subjects, on the basis of 
scholarly interest. The courses need not be technical, narrowly 
"practical," or in any way prematurely "professional": but their 
relation to each other in the concentration schedule should be openly 
determined by the vocational objective on which they all bear. It 
is the frank avowal of the vocational aim of certain combinations 
of coiu*ses that is important. The courses themselves may deal with 
matters more or less remote from the occupation in view, provided 
that in combination they afford a sultable preparation for tndy 
vocational study, and are so advertised. The extent to which any 
given course shall indude training of a strictly practical character is 
in any case a matter for adjustment in each course; but this plan 
necessitates no particular amount of practical work at any prescribed 
point. 

Indeed, this plan offers a means of maintaining the generally ''lib- 
eral " character of the baccalaureate curriculum, with allits advantages. 
It does not force the choice of a profession. It does not hamper the 
teacher of every upper-dass course by prescribing for his instruction 
a vocational outcome. But it does permit students whose vocational 
purposes are already defined to shape their work in accordance with 
their intentions. It fosters in others, but not unduly, the tendency 
to define such purposes. It should prevent waste of effort and 
simplify the problem of the adviser. 

Professor Day suggests that in Economics the necessary guidance 
should be given by the Tutors. This is doubtless desirable, and in 
making the connections between courses the Tutors can do much 
service by darif)dng the relation between the study of college Eco- 
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nomics and the work to which individual students may be looking 
forward. It will still be necessary, however, to establish and publish 
sequences of courses, and to state in the Department pamphlet the 
bearing of courses on preparation for vocations or on vocational 
training in a graduat& school. And outside the field of Economics, 
Schedules of other courses — e.g., courses preparatory to the study 
of medidne — ought to be established as approved Schedules for 
concentration. 

In such Schedules continuity of intellectual eflfort and unity of 
Outlook must, of course, be safeguarded: a schedule that is merely a 
hodge-podge of unrelated courses would be at least subject to sus- 
picion, even if it could be justified on the ground of vocational in- 
tent. Some present concentrations, however, lack imity, or at least 
seem to lack it, if one considers only the names of courses; and ex- 
perience with concentrations in Mathematics and Education (per- 
mitted because there is a field of that name, in which one may be 
a candidate for the degree with distinction) shows that a vocational 
purpose can hold together studies which differ considerably in content. 

This chapter is essentially an argument for giving up academic 
distinctions and catalogue divisions as a basis for determining curric- 
ula, and tuming to the realities the rules are meant to serve — the 
purposes and interests of students and the fieids of endeavor and in- 
terpretation in life. 



CHAPTER III 

QUANTITATIVE STUDIES FROM STUDENTS' 
RECORDS — STUDIES IN CORRELATION 

I. EcoNOMics AND Other Subjects — Trend of Student 

Elections 

An attempt is made in this section of the Report to deter- 
mine, in general, what kind of students pursue courses in 
the Department of Economics. 

In the first place, the scholastic interests of the students 
concemed, — in so far as they are indicated by the election 
of courses outside of the Department, — have been studied. 
There is an impression that the students who do the best 
work in the Department show a distinctly scientific and 
mathematical bent. This opinion, however, is not borne 
out by their election of courses. 

The choice of studies in the case of a thousand students of 
the Department was first canvassed. These students had 
taken on the average between three and f our half-courses in 
Economics. The courses taken outside the Department 
were classified for the purposes of this study into three 
groups: (i) History, Government, Education, Philosophy, 
Psychology, Social Ethics, Music, History of Religion, and 
Fine Arts; (2) English, Comparative Literature, German, 
French, Latin, Greek, Italian; (3) Mathematics, Geology, 
Physics, Chemistry, Astronomy, Engineering, Physiology, 
Anatomy, Zoology, Botany, and Mining. 

Among the one thousand records, there were thirty-five 

^ which showed the election of twelve or more half-co\u:ses in 

35 
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the Dq)artment. This number of courses would seem to be 

sufficient evidence of specialization in Economics. The 

elections of these students outside the Department are 
shown in the f oUowing table, classified according to the above 
mentioned groups: 

TABLE I 

Student I H HI Total Tendency 

I 9 9 18 I-II 

2 13 6 4 33 I 

3 10 9 8 27 i-n-m 

4 IX 9 4 34 i-ii 

5 10 7 3 19 I 

6 10 8 s 33 I-II 

7 8 8 s 31 I-n 

8 s 8 .. 13 II 

9 II S I 17 I 

10 10 6 .. z6 I 

II 6 II .. 17 n 

13 3 15 .. 17 II 

13 3 6 10 18 m 

14 7 6 .. 13 I-n 

IS 8 s s 18 I 

16 II 3 I 14 I 

17 7 6 10 33 in 

18 9 3 3 14 I 

19 13 8 6 37 I 

20 10 7 4 21 I 

21 14 12 3 28 I-n 

22 6 II .. 17 n 

23 7 8 4 19 I-n 

24 7 10 10 27 n-in 

25 12 3 I 16 I 

26 3 14 3 18 n 

27 10 .. 6 16 I 

28 II II 4 26 I-n 

29 6 8 6 20 i-ii-m 

30 I 12 4 17 n 

31 21 5 3 28 I 

32 II 6 6 23 I 

33 II s 4 20 I 

34 14 16 I 31 I-n 

35 9 7 .. 16 I-n 

Explanation of Table I: To show the field m which a student's work lay, 
the record for each student was classified according to the niunber of half- 
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coTirses taken. This was done in the following way: if the total nxunber of 
half-courses was less than twenty, the nxunber in the maximiun group 
must be greater than the siun of the other two, in order to be considered 
as sufficient evidence of concentration. If the total number of half-courses 
was over twenty, there must be a plurality of at least three half-courses. 
If there was not a plurality of at least three half-courses, the groups were 
combined. 

TABLE n 

(Table II is a siimmary of the result of Table I) 

Group 

I 14 

n 6 

ni 2 

I-n 10 

i-n-ra 2 

n-m I 

35 

Explanaiion of Tabk II: This means that of those students who took 
twelve half-courses in Economics, fourteen, or 40 per cent, were interested 
decidedly in what are termed purely cultural subjects; six, or 17 per cent, 
specialized in language; and only two, or 5 per cent, were students of the 
mathematical and "scientific" subjects. Ten, or 29 per cent, were students 
who took the orthodox college course of language and cultural subjects; 
two, or 5 per cent, had an evenly distributed course. The group which 
combined I and II was clearly inclined away from the sdentific side, towards 
the established academic course. Therefore, if we add groups I and I — II 
(14 -f 10 = 24) we find that 68 per cent of the students were not especially 
interested in the subjects of the third group. Further, if we distribute the 
six students of Group II on the basis of their inclination towards I or III, 
we find that f our took no courses in Group III and are concemed only with 
I and II; that one has two courses in each of II and HI; and one is in favor 
of m. We may therefore add these four (24 -f 4 = 28) which would in- 
dicate that about 80 per cent of the students in question are chiefly 
interested in the studies of Groups I and II. 

The cards of all the students of the Department between 
the years 1904-05 and 19 12-13 were then classified on the 
basis of speciaUzation in one or the other of the three groups. 
Only students, in the first place, who had taken two or more 
courses in Economics; and, in the second place, only those 
who by electing eight or more half-courses in one of the above 
groups gave evidence of some speciaUzation in these various 
groups, were considered. Of the eight hundred and ninety- 
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nine records thus selected, one hundred and fifty-six fell in 
Group I; five hxmdred and twenty-two in Group II; and 
two hxmdred and twenty-one in Group III. 

Table III shows the grades which these men received in 
Economics. 

TABLE m 

I n ra 

A 26 ' 35 r 28 

B 54 114 • 43 

C 52 253 •105 

D 19 103 40 * 

E _3 17 S 

Totals 154 »> V 5120. >. ;22i 

Per Cents o£ Whole Group 17 58 '25 

Table IV gives the same facts reduced to percentages, e. g., 
17 per cent of Group I received A in Economics as com- 
pared with 7 per cent of Group II and 13 per cent of Group 
III. Taking the grades A and B together, 52 per cent of 
Group I receive superior grades in Economics; 29 per cent 
of Group II; and 33 per cent of Group III. 
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Conclusions: A study of the records of the elections of 
approximately nine himdred students of the Economics 
Department shows that about three-fifths (58 per cent) of the 
students concentrated in their work outside of the Depart- 
ment in the language group of studies. About one-fourth 
concentrated in Mathematics and Science, and less than a 
fifth (17 per cent) in a group of studies including History, 
Government, Philosophy, and Fine Arts. The students, how- 
ever, who concentrated in this last group of studies (Group I) 
received superior grades (i. e., A or B) in their coiurses in 
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Economics in about a fifth more of the cases than did the 
students who were classified in either of the other groups. 
There is no reason to believe that Economics has any natural 
affliation with mathematics and science or that interest in 
mathematics and science promises well for success in 
Economics. 

II. Distribution of Grades in Courses in Economics 

AND IN SeCTIONS OF CoiTRSE A 

In the following table, the grades given to thirty-eight 
himdred and sixty-three students in Economics A are shown, 
and secondly, the grades received by eight himdred and 
ninety individuals in the more advanced courses in the 
Department. These eight himdred and ninety individuals 
had each taken six or more half-courses beyond Economics 
A. For purposes of comparison the grades have been re- 
duced to percentages and their distribution shown in Plate I. 

table V 

Distributions of Grades m Economics A and en Advanced Courses 

A B c D £ Totals 

Economics A 364 987 1874 523 115 3863 

Per Cent in Economics A . . 9 26 49 14 3 

Advanced Courses 603 2041 3398 718 164 6924 

Per Cent in Advanced Courses 9 30 49 10 2 

The grading, as the table and chart show, is somewhat 
higher in the advanced courses. The smaller number of the 
E and D grade students electing advanced courses is sufl5- 
cient to accoimt for this difference. It is to be noted, fur- 
ther, that the distributions are not symmetricai, there being 
a somewhat larger proportion of A and B grades given than 
of D and E grades. 

Uniformity of marking on the part of the individual in- 
structors in the Department would doubtless be promoted 
by givmg some attention to the general practice of th^ De- 
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partment, as shown in these distributions. This statement 
should not be construed as meaning that the marks assigned 
by an instructor to a small group of students should neces- 
sarily even approximate to these distributions. Quite the 
contrary: It would seldom happen that an instructor's 
"sampling" of the student body, in the case of any one 
class, would be an exactly average "sampling," — which 
is what would be indicated were he to distribute his marks 
according to the percentages given above. But in the 
couxse of several years the grades in his various classes or 
sections should, when totaled, approximate the above dis- 
tribution, unless, to be sure, there were exceptional factors, 
e. g., election of the course by a superior grade of students 
only.^ These more general questions are discussed in the 
chapter on Marking. 

The above distributions represent the average results of 
the marking of the instructors of the Department. Instead 
of reconciling differences in standards by striking an average, 
it would doubtless be better to set up a standard upon which 
several of the instructors already agree, — if a Department 
is fortimate enough to have such agreement and provided 
there is a reasonable basis for the agreement. For the pres- 
ent, however, it may be sufficient to take the above distribu- 
tions as representing the general standard of the Depart- 
ment of Economics. 

The question of the imiformity of grading in the Depart- 
ment has been studied more specifically in the case of the 
section grading in Economics A. These sections are, in 
the first instance, f ormed without reference to the quality of 
students, so that in the course of a few years, at any rate, 
each instructor should have secured about the same pro- 

^ In an unpublished study of marking in Harvard courses A. J. Inglis has shown 
that even a standard distribution based on the combination of marks in large in- 
roductory courses cannot saf ely be used as a basis for distributions in upper class 
coi|i$ef. 
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portion of the various grades of students, and if his assign- 
ment of grades differs much from the general practice, it 
must be accounted for in other ways, e. g., marked supe- 
riority or inf eriority of instruction, — matters which then 
may reasonably be inquired into. 

The grades given in the several sections of Economics A 
during the years 1913-14 and 1914-15, including both 
mid-year and final marks, have been tabulated. The re- 
sults are shown in the f ollowing tables of percentages and in 
the accompanying charts (Piates II to VI inclusive).^ 
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" D . 3 20 45 25 7 .5 21 51 24 4 

As may be best seen from the charts, there is a much 
greater diversity of practice than can be accounted for on the 
basis of differences in the quality of students in the various 
sections. Furthermore, only in the case of one instnictor 
(D) is there agreement between the proportions of grades 
assigned at the mid-years and at the finals. In general, there 
is a larger proportion of low grades given at the mid-years. 
This is due in part to the dropping out of the poorer stu- 
dents after the mid-years, in part to an actual improvement 
in the performance of the students who remain. The em- 
plojnnent of a standard at the mid-years more severe than 
the standard employed at the finals could have no justifica- 

I At mid-years, an AA section, so-called, is formed by selecting those 
doing A-grade of work in the various sections. The marks for these sections 
are included only in the combined distribution of the final marks as shown in 
Plate VI. 
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tion except in a dangerous theory o£ marking for "moral" 
effect. As the chapter on Marking points out, the only 
advisable course in assigning grades is to use every eflfort to 
be accurate at the time the grade is assigned. 

One instructor (C) has a perfectly symmetricai distribu- 
tion o£ grades at the finals, which difiFers very markedly 
from any of the other section distributions, and also from 
the general distribution of grades shown in the preceding 
chart. This would imply a conscious use of the "probabil- 
ity" distribution curve. This practice, we believe, is not 
justifiable. The emplojnnent of a fixed form of distribution 
in the case of a small group of students is boimd to do in- 
justice, since no two successive groups, except by chance of 
definite selection, will be the same in the proportions of the 
various grades of students. If any form of distribution is 
to be followed, that representing the practice of the De- 
partment as a whole in the marking of the total group will 
do least injustice. 

III. Elementary Courses and Advanced — Cokrela- 
TiON or Elections and or Grades 

A. The Relation of Ecottomics A to the Advanced Courses 
of the Department. Seventy-one and nine-tenths per cent of 
the students of Economics A elect further coiurses in the 
Department. This percentage is based on the records of 
3856 students during the years covered by this investiga- 
tion. The extent of further elections beyond Economics A 
is shown in Table VII and in Plate VII. 

TABLE vn 

Numbess AMD Per Cents of Students Taking One or More Courses 

No. of Courses z 33 456 7 8 9 xo zz za 13 

Number . 1083 301 569 349 363 308 243 191 152 112 74 48 63 
Per Cent of 

Students 28 8 15 9 10 8 6 5 4 3212 
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In addition to the number of students, it is also a matter 
of interest and concem to the Department to know some- 
thing of the kind of student who goes on. Do, for example, 
the students who receive grade D in the introductory 
course continue in equal numbers with those who receive A? 
Standing in the introductory course is, of course, not a final 
indication of the student's fitness for further study, but it is 
" contributory " evidence. 

The facts as to the continuance in the Department of the 
A, B, C, D, and E men of Economics A are shown in Table 
VIII and in the accompanying plate (Plate VIII). 

TABLE VIII 

Number of A, B, C, D, and E Men Who Took One or More 

Courses in Economics 

No. of Courses x 3 3 4 5 6 78 9 zo zi za 13 Totab 

A men 96 20 57 26 37 29 24 15 20 16 9 5 12 366 

B men 290 65 136 75 95 61 64 65 54 35 19 11 14 984 

C men 481 156 276 183 171 171 118 92 63 54 40 28 34 1867 

D men .... iS4 53 87 59 49 44 31 16 12 6643 S24 

E men 62 7 13 611 3 6 3 3 i o o o 115 

Totals 1083 301 569 349 363 308 243 191 152 112 74 48 63 3856 

The students who receive the grades of B and C in the 
introductory course are in the large majority in the advanced 
classes. In actual numbers there are more D men who con- 
tinue than A men; only in the coimt for more than eight 
courses do the A men begin to outnumber the D men for 
each additional course. 

If one considers the total number who take six or more 
courses (883 cases), the following are the findings: 

A B c D E 

loi 262 429 78 13 

11% 30% 49% 9% 1% 

The percentages for the various nimibers of courses taken 
are shown in Table X.^ Fifty-four per cent of the E men 

* See below page 47. This table repeats Table VIII in percentages. 
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do not continue. About equal percentages o£ D, C, and B 
men (26 per cent- 29 per cent) and a somewhat smaller 
percentage o£ A men (23 per cent) do not continue. There 
is a distinct difiFerence to be noted between the A and B 
men in Economics A, on the one hånd, and the D and E men 
on the other. The data, however, do not show whether part 
of this difference is due to the faet that D and E men leave 
college altogether. If a man leaves college, of course he 
does not take advanced courses in any department, Eco- 
nomics among the rest; so that in the group of those who 
take from six to twelve advanced courses a lower percen- 
tage of men of any given standing is produced by those 
who drop out of college, as well as by those who stay and 
prefer to do their work in other departments. 

Speaking in general, then, about one-half of those who 
receive E in Economics A continue in the Department, and 
approximately three-fourths of those receiving each of the 
other grades. 

Leaving out the question of the E men, some of whom 
doubtless leave college, the grade received in the intro- 
ductory course appears to have no particular effect on elec- 
tions of advanced coiurses in the Department. 

Another way of grouping the students of Economics A 
is according to the grade of the advanced coiurses taken by 
those receiving the various marks in Economics A. " Grade " 
here means only the distinction between a coiurse that is 
open to both graduates and imdergtaduates, and one that 
is open to graduate students exclusively. The differences 
in the extent of elections in the lower, middle, and upper 
group courses may be seen in the accompanying chart 
(Plate IX). Thus, of the 46 per cent of men who received 
E in Economics A and took further courses in the Depart- 
ment, 45 per cent took only those courses open to both 
undergraduate and graduate students, only 0.9 per cent tak- 
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ing exclusivdy graduate courses, this being a single indi- 
vidual. The 71 per cent of the D men who did some ad- 
vanced work in Economics did it exclusively in courses open 
to undergraduates. Of the C men, only 0.5 per cent took 
exclusively graduate courses, ten individuals out of eighteen 
himdred and seventy-four. A slightly larger percentage of 
those who received B in Economics A took exclusively 
graduate courses, 0.8 per cent, or eight individuals out of 
nine himdred and eighty-seven who received B in Eco- 
nomics A (a smaller number, but a slightly larger propor- 
tion). In the case of the A men of Economics A, both the 
actual number and the proportion is greater, for eleven 
men out of three hundred and sixty-four who received A 
in Economics A went on to exclusively graduate courses. 
This is 3 per cent, or the same proportion of A men as took 
twelve half -courses beyond Economics A. 

The grouping according to grade of courses serves to 
differentiate between those who received A in Economics A 
and those who received B. Actual nimibers of individuals 
are as f ollows in our data (Plate IX) : 

TABLE rx 

Number of Economics A men in study 3863 

" who took exclusively graduate courses 30 

" of these who were A men in Economics A . . . . 11 

" who were B men in Economics A 8 

" who were C men in Economics A 10 

" who were D men in Economics A o 

" who were E men in Economics A i 

If the same proportion of the B men in Economics A took 
exclusively graduate courses as of the A men there would 
have been thirty instead of the eight. The same proportion 
of the eighteen himdred and seventy-four C men would 
have given fifty-seven, instead of ten. Considering the dis- 
proportionately large number of A men who take exclusively 
graduate courses as compared with the B, C, and D men, 



46 THE TEACHING OF ECONOMICS 

it may be said that the grading in Economics A has to a 
certain extent differentiated the students, since it gives A 
to a third of the men who af terwards take exclusively grad- 
uate courses, whereas it gives A to only about a tenth of the 
whole number of Economics A students. It gives B to about 
one-third of those who af terwards take exclusively graduate 
courses and to four-tenths of all the students in Economics 

A, from which it may be deduced that a man receiving A in 
Economics A is f our times as likely to go on to exclusively 
graduate courses as is the man in Economics A who receives 

B. In other words, the proportion of A men in Economics A 
who take exclusively graduate courses is f our times as great 
as of the B men. The rule of the Department that only 
candidates for the degree with distinction shall be admitted 
to graduate courses practically excludes from them all but 
the A and B men. 

The general conclusions as to the connection between 
grades in Economics A and the election of advanced courses 
are: (i) About twice the proportion of A and B students take 
six or more courses in Economics beyond Economics A as D 
students. The proportion of C students is midway between. 
(2) The proportion of E students who take courses beyond 
Economics A is only half that of aU other grades. Our data 
do not show what part of this is due to E students dropping 
entirely out of coUege. (3) Four times as large a percentage 
of A students take exclusively graduate courses as of B 
students. (4) Standing in Economics A does not greatly 
deter or incite to further elections in the Department, but 
it is fairly reliable as an indication of a student's probable 
advance into strictly graduate study. 
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TABLE X 

Table Showing Percentages of those Receiving THE Vasious 

Gkades m EcoNOMics A who Elect Diffesent Nuhbers of 

Advanced Courses m Economics 

Number of Half -counes Bcyond Economics A 



Grade in 
Economics A 





X 


3 


3 


4 


5 


6 


7 


8 


9 


10 


IX 


13 


A • • < • 


23 


5 


16 


7 


10 


8 


7 


4 


5 


4 


2 


I 


3 


. . . . 


29 


7 


4 


8 


10 


6 


7 


7 


5 


4 


2 


I 


I 


\^ • • • • 


26 


8 


14 


10 


9 


9 


6 


5 


3 


3 


2 


I 


2 


D . . . . 


29 


10 


17 


II 


9 


8 


6 


3 


2 


I 


I 


0.7 


O.S 



E . 



54 6 II S 10 3 S 3 3 0-8 



B. The Relation between Grades in Economics A and in 
Other Cour ses in the Department of Economics. The previous 
sub-section reported the facts as to the sort of students 
who elect advanced coiirses in the Department, judged on 
the basis of their grades in the introductory course. It is 
also of interest to inquire whether the grades obtained in 
the introductory course give indication of the probable 
standing of the students in the advanced courses of the 
Department. Is there reason for encouraging an A student 
in Economics A to elect advanced courses rather than a D 
student; and is the A student more likely to receive higher 
grades in these courses than the D student? 

Eight hundred and ninety individuals are included in this 
study, each of whom took six or more half-courses beyond 
Economics A.^ The distribution of the marks in Economics 
A was that 96 received A; 268 received B; 420 received C; 
78, D; and 28, E. The percentages are as follows: A, 11; 
B,3o;C,47;D,9;E, 3. 

The A men of Economics A received seven hundred and 
thirty-eight marks in advanced courses, about a third of 
these being A's. The B men of Economics A received two 
thousand and fifty marks in advanced courses, a tenth of 

^ Seven additional cases to the 883 discussed in section A of this chapter have 
been induded in this part of the study. 
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these being A's. Of the marks in advanced studies given 
to men who stood D and E in Economics A, only one in 
fif ty was an A, while the C men in Economics A succeeded 
once in thirty times in getting an A in advanced courses. 
These facts are shown in the A row of the table, showing 
the percentage of A's in advanced courses obtained by A 
men, B men, etc, of Economics A; e. g., thirty-five per 
cent of the marks in advanced courses of men receiving A in 
Economics A were A, f orty-f our per cent of their marks in 
advanced courses were B, etc. 

TABLE XI 

Table Showing the Percentages of the Various Masks in 

Advanced Courses in Economics Obtained by those 

Receiving the Vasious Marks in Economics A 



Marks in 
Advanced Courses 


A 


Marks in Economics A 
B c 


D 


E 


A . . . 


35 


10 3 


2 


2 


B . . 


. 44 


44 ^^ 


10 


13 


C . . 


20 


40 60 


5S 


SS 


D . . 


I 


6 13 


33 


23 


E . . 


0.2 


0.8 3 


7 


6 



The heavy-faced type indicates what is cailed "absolute 
retention"; that is, sixty per cent of the marks of the C men 
of Economics A were also C in the advanced courses. This 
is the percentage of perfect retention. The italic indicates 
"approximate retention"; that is, twenty-one per cent of 
the marks of the C men were B in the advanced courses, and 
thirteen per cent were D, so that the total "approximate 
retention" here is thirty-four per cent. The grades which 
are still further dispersed from the grade in Economics A 
are printed in ordinary type. The greatest scattering of 
the grades in the advanced courses is in the colunm of 
the E men, half of whose marks in the advanced courses 
are C. The E men of Economics A receive about the same 
proportion of C's in the advanced courses as do the C men 
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and D men. Fifty-four marks out of ninety-foiir given in 
advanced studies to men who had received E in Economics 
A were C. 

These facts are clearly shown in the series of graphs in 
Plate X, In general, it is evident that the practice of the 
Department is to lower the grades of the A and B men who 
continue in the Department and raise the grades of the D 
and E men. This practice, there is every reason to believe, 
misrepresents the facts of the case and is due largely to the 
artificialities of grading. It is reasonable to believe that the 
A and B men of the introductory course are quite as capable 
of at least maintaining their rank as the poorer students 
are of improving theirs. To offset this conclusion Professor 
Day has suggested that certain men do good work in ad- 
vanced courses of a more or less practical character, whereas 
the general and largely theoretical character of the intro- 
ductory course may make it dijQ5cult for them to get marks 
of distinction. 

The actual numbers of marks received by the various 
groups of students in the six or more additional half-courses 
are as f oUows : (from this table it is possible to calculate the 
degree of closeness in agreement between grades in Eco- 
nomics A and in the advanced courses). 

TABLE xn 

Table of the Diffesent Grades m Advanced Courses m Ecx)nomics 
Received by Students Receiving the Various Grades in Economics A 

WHO TOOK SdC or MORE HaLF-CoURSES IN EcONOMICS BeYOND EcONOMICS A 







Marks in Economics A 






Marks in the 
Advanced Counes 


A 


B 


C 


D 


E 


Suma 


A. . . 


258 


205 


100 


II 


2 


576 


B . . . 


325 


944 


703 


57 


12 


2041 


C. . . 


147 


862 


2006 


331 


52 


3398 


D. . . 


7 


123 


435 


131 


22 


718 


E . . . 


I 


16 


lOI 


40 


6 


164 


Sums . . 


738 


2150 


3345 


570 


94 


6897 
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The product-moment (Pearson) coefficient of correlation 
between grades in Economics A and advanced courses in 
Economics of those who took six or more advanced half- 
courses is r = + 39.4 per cent. It will be of interest to 
compare this coefficient of correlation with those given in 
Section IV. It indicates but a small amount of relation be- 
tween the standing of students in their introductory and 
advanced work. This is probably in large part a misrepre- 
sentation of the facts, due to a somewhat arbitrary lowering 
of the grades of the superior students of Economics A and 
an equaUy arbitrary raising of the grades of the inf erior stu- 
dents; but in itself it shows that standing in Economics A 
is not, under present conditions, a very reliable guide to 
probable standing in advanced courses. 

One further point of interest in connection with the rela- 
tion of grades in the introductory and advanced courses may 
be mentioned. The grades in Economics A of students who 
go on to the extent of taking six or more half-courses are 
on the average somewhat higher than the grades of those 
who take fewer courses. In order to secure these averages, 
the f oUowing values were given to the grades : A « i ; B = 2 ; 
C=3;D=4.s;E=6. (Cf. Appendix A, below.) The 
grades of the eight hundred and ninety students who took 
six or more courses average 2.69; of those, twenty-nine hun- 
dred and sixty-six in number, who took less than six courses, 
the average grade is 2.90, which is about one-fifth of a grade 
below. The students who go on to do much work in Eco- 
nomics stand higher than those who do not. This supple- 
ments the conclusion presented above as to election of 
advanced courses. The future specialist in Economics is 
marked by what he does in course A; but a man who does 
poorly in that course may neverthdess take a good many 
advanced courses and do well in them. 

Of even more significance are the differences among the 
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groups which elect individual cotirses. The average grade 
in Economics A of those who subsequently take Economic 
Theory is very high, 1.76; of those who take Economic His- 
tory, 2.54; of those who take Money and Banking, 2.66; and 
of those who take Sociology, 2.64. This shows that there 
is marked variance in the average abilities of the groups 
selected by the advanced cotirses. It is worth while for an 
instructor to know the standing of his men, not only in the 
introductory coiurse in his department, but in the whole 
range of each student's work. A brilliant group of students 
should not be taught or marked as an ordinary, imsdected 
group. 

The recent decisions of the Department conceming elec- 
tion of graduate courses by undergraduates do not afifect the 
conclusions of this section, for the data were gathered from 
the students* records in years before the decisions were made, 
and the problems involved persist in spite of them. 

rv. Economics and Other Subjects — Correlation of 

Grades 

A. The Significance of Correlations. When comparison of 
the grades received by the same students in two different 
courses shows that those who receive A in the one also re- 
ceive A in the other, B in the one, also B in the other, and 
so on; or when it shows a tendency to such agreement so 
marked as unquestionably to be more than a matter of 
chance; and especially when one pair of courses shows such 
positive correlation much more markedly than another pair 
— then it is evidently worth while to discover the factors at 
work in producing so noticeable a result. Thus Economics 
A and Mathematics C show a correlation of 58 per cent — 
an agreement more than half complete; whereas Economics 
A and Admission Civil Government show no correlation at 
aU, their coefficient ( — .01) being so near zero as to indicate 
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no significant relation whatever between the two series of 
marks. What do these facts imply? 

Granted that the students are really the same — that they 
are not only the same persons, but that their general capac- 
ity for work, their determination to succeed, and their power 
of assimilation remain unchanged, then the only other factors 
which can operate to produce or prevent correlation are, 
first, the closely related character of the subjects as they are 
presented to the student by the instruction he receives, and 
second, the accuracy with which the instructors estimate 
each student's achievement. It is natural to suppose these 
factors operative in producing such a correlation as that 
between Physics C and Mathematics C, which is .61. 

The fundamental capacity of the student does not, of 
course, remain always exactly the same; his vitality varies 
even from day to day, and a change in health or circum- 
stances may make a marked change in that mysterious 
"central factor" of intelligence which undoubtedly plays 
an important part in inteUectual accomplishment : but this 
factor, as a number of studies^ show, does remain fairly 
constant, "good students" persisting throughout their 
whole scholastic career (and, so far as has yet been deter- 
mined,^ later in life as well) in capturing the "high marks". 
Positive correlation may therefore be explained in part on 
the ground of persistence in relative native ability, including 
in that term the important element of purpose or will. 

This tendency of native ability to give men the same rank 
in two courses no doubt has something to do with a correla- 
tion such as that between Economics A and Government I, 
which is .56; but on the basis of such an explanation we 

^ Dearbom, W. F. The Relative Standing of Pupils in the High School and 
in the University, Madison, Wis., 1909. 

* Cf. President Lowell's study of College Rank and Distinction in Life, AUatUic 
MotUhly, October, 1903, also President LoweU's study of CoUege Studies and 
Professional Training, Educational Review, October, 191 1. 
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might here expect an even higher correlation, since these 
courses attrået men of about the same age and college stand- 
ing : also, how shall we account on grounds of native ability 
for the difference between the correlations of Economics A 
— Government I, which is .56, and English A — History I, 
which is only .40? The men who take these courses are prac- 
tically the same; they form a large group, without much possi- 
ble variation in native ability from one course to the other. 

There can be no question of the faet that native ability 
is cailed forth in differing degrees by different subjects — 
that the students who respond to and work effectively in 
some subjects are not equaUy stimulated by others. The 
appeal of a subject is affected, of course, by the method of its 
presentation and by the personality of the teacher; yet it 
may legitimately be supposed that these factors will not, 
ordinarily, so greatly disturb the relative rank of students, 
on which the calculation of a correlation coefficient is based, 
as to obscure the effect of the subject itself on the varying 
character of their minds. Positive correlation may also be 
taken to indicate, therefore, that the requirements of two 
subjects are germane — that they appeal in equal degree 
to minds of equal capacity, and similar interests, and that 
for the student, the vital question of probable success in 
study may receive the same answer in both. To take one 
of these subjects may be supposed to be helpful in taking 
the other, either because of relation in the content of the 
subjects or because of relation in the point of view or habit 
of attack required. This similarity of content or method 
probably helps to produce the relatively high correlation 
between Economics A and Government I, and the even 
higher correlation (.67) between Economics A and the ad- 
vanced course in Economic Theory, although in the latter 
case it is possible that other factors, to be mentioned later, 
are also at work. 
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Positive correlation presupposes the same degree of ac- 
ciiracy in marking. It cannot be said that any marking is 
very accurate; justice, as a later chapter of the Report points 
out, is almost as dijQ&cult in marking as in the law. But 
granted an equal efifort to be just and granted bases of judg- 
ment not essentially different, the variations from accuracy 
in the case of two instnictors will not fatally disturb the 
action of other factors in bringing about the same distribu- 
tion of ranks in their two courses. Standards may vary 
without any efifect on correlation, provided students of all 
ranks take both the courses in question; for mere severity, 
equitably applied, will not prevent students at the top of 
the list in an "easy " course from being at the top of the list 
in a "hard" one. But low correlation, or absence of cor- 
relation, or negative correlation, may indicate that marking 
in one course is based on considerations given little weight 
in another; as for example, when in one course a student 
may eam a C or a B by virtue of careful, well-orgamzed, 
faithful work, whereas in another he is required to show 
imagination or graces of form in themes or essays. The low 
correlation between Economics A and English A (.27) may 
perhaps be accounted for on these grounds. Such a differ- 
ence in principles of judgment may be considered an aspect 
of the difference between one subject and another: but 
in certain cases it may indicate that marking in a given 
course is not well regulated or based on clearly conceived 
requirements. 

One other possibUity in marking may affect correlation, 
namely, the possibUity that only the good students in one 
course (of the correlated pair) take the other, and that in 
that other, the marking is relatively high : — then correla- 
tion will also be high. This may be partly the case in the 
Economics A — Economic Theory correlation, as facts 
presented at the end of Section III suggest. It was there 
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shown that the average grade of men taking Economic 
Theory was very high, namely, 1.76 (or approximately B +) 
and the coefficient of correlation is correspondingly high, — 
(.67). Or if only poor students in one conrse take the other, 
and the marking is high, then correlation will be low — and 
other cases can be imagined. If correlation is not to be 
obscnred by differences of standard, students of all ranks 
must be present in both courses. The method of correlating 
explained below is especially devised, however, to discount 
ordinary differences in the "form" of distributions — e. g., 
the difference between an instructor who habitually gives 
10 per cent of A*s and an instructor who never gives more 
than 2 per cent. 

On the whole, it must be admitted that the significance of 
many of the correlation coefficients here reported is in good 
part a matter of conjecture. None of the correlations we 
have worked out is strikingly high; only one is negative; but 
some are much higher than others. Those who know the 
courses must consider the various possible explanations for 
difference in correlation between any two pairs. In the 
case of two pairs of large courses, such as the pairs Econom- 
ics A — History I and Economics A — English A, relative 
native ability as a factor may be dismissed. These courses 
get students of all abUities; and on that score the correla- 
tions of the two pairs should be the same. Difference in 
correlation between the two pairs must indicate differences 
in the relations of the subjects or in the bases for marking. 
There is also the possibUity that really marked differences 
in the effectiveness of the teaching would appear in such 
differences of correlation; for if of two courses it were true 
that good teaching in each won successful effort from stu- 
dents in approximately equal degree, whereas of two others 
it were true that one secured it in high degree, but the other 
only from those who could not be discouraged by any teach- 
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ing, however uninspired, then the correlation of the first 
two, other things equal^ would be much higher than that of 
the other two. No courses we have correlated can be said 
to vary in any such way, but variations in efifectiveness of 
teaching do of course exist, and they cannot be left wholly 
out of account. 

It is not safe, in any case, to draw the conclusion that the 
training given in one course is of advantage in another, 
merely because the two correlate, or that the training in one 
is barren of results in the other because they do not corre- 
late. But when courses do correlate, it is reasonable to ex- 
pect that a student who has done weU in one will do weU in 
the other, and hence to advise him for his own sake to take 
it — or if one's philosophy so dictates, not to take it. 

B. Corr dations — Ecatwmics and Other Subjects. The 
method by which the main set of correlations (given in 
Table XV) was calculated is explained below. It differs 
somewhat from the method in common use, and makes 
certain appreciable differences in the rankmg of the various 
pairs of courses, as to correlation. In order to calculate the 

correlations it was necessary to translate the letters A, B, C, 

• 

D, and E, into numerical values, which were assigned as 
foUows: A = I, B = 2, C = 3, D = 4.5, E = 6. This 
Schedule was adopted after a study of the grouping of the 
grades given in various courses.^ 

The first set of correlations was calculated in order to ob- 
tain an average correlation for typical pairs of courses not 
including any course in Economics. It would be desirable 
to get correlations for a larger number of pairs, in order to 
secure an average correlation more widely representative of 
the various subjects taught in the college; but the average 
correlation obtained is usef ul enough for the present purpose. 

^ For a discussion of the evaluation of grades see Appendix A, at the end of 
this section. 
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TABLE Xin 

COKRELATIONS ^ IN PAUIS OF COXTRSES NOT INCLUDING ANY 

COUKSE IN ECONOMICS 

Coeffident of 
Number of Correlation 

cases Courses (r-i) 

182 . . . Ph3rsics B or C and Mathematics C or F . . . .55 

890 . . . History i " Government I 54 

276 . . . German A or B " Latin A or B 53 

114 . . . English A " History I 32 

68 . . . EngUshA " PhilosophyA 28 

1530 

The weighted average of the coefficients of correlation for 
these pairs is .50. This figure may be taken as a guide in 
deciding whether a given correlation between Harvard 
courses is high or low. It, as well as the separate correla- 
tions of Table XIII, is reckoned by the "product-moment" 
(Pearson) method (coefficient designated "r"); and would 
have been somewhat higher if reckoned by the "rank-dif- 
f erence-squared " method (coefficient designated "rho")> 
by which the longer list of correlations given ih Table XV 
was calculated. The range of the correlations in Table 
XIII shows the amount of difference in the tendency of 
different pairs of courses to cause shifting of ranks. 

Table XXV gives correlations between Economics A and 
various other courses, both in Economics and in other sub- 
jects. These are also reckoned by the "product-moment" 
method, and may be compared directly with the correla- 
tions given in Table XIII. 

1 Coeffidents of correlation are in terms of r, the "product-moment" method 
of Pearson. 
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TABLE XIV 

COSBELATIONS BeTWEEN EcONOMICS A AND OtHER CoUSSES 



("Product-moment" fonnula) 



Numberof 
cases 

167 

143 

S 10 
263 

334 

387 
811 

346 
528 

439 

6897 

432 

334 
168 



Coeffident of 

Correlati<»i 

(r-) 



Couxses 

Economics A and Mathematics C 52 

Economic Theory 51 

Government I 51 

Money and Banking 50 

German A or B 48 

Sociology 48 

Econ. Histoiy U. S 47 

Physics B or C 46 

Histoiy I 42 

Mathematics F 40 

All other Economics courses ... .39 

Chemistry I 36 

Latin A or B 33 

English A 23 
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The weighted average of these correlations is 41. 

The faet that only three correlations in this list are higher 
than the average for the pairs listed in Table XIII and none 
as high as the three highest of that five, deserves some com- 
ment. It is due in part to the faet that the "produet- 
moment" method of ealenlation takes no aeeount of the 
dififerenees in habit of marking between two instruetors, 
as is explained below. By the " rank-diff erenee-squared " 
method some of these eorrelations are eonsiderably higher 
in the total list. (See Table XV.) Even so, the only eourses, 
outside of other Eeonomies eourses, with whieh Eeonomies A 
eorrelates partieularly well are Mathematies C and Gov- 
ernment I. An explanation for the eorrelation with Gov- 
ernment I is suggested above; ^ the eorrelation is not im- 
natural, sinee the two eourses are large imder-elass eourses, 
not unrelated in eontent. Is it possible that the eorrelation 

^ It is interesting to note that in reply to the questionnaires a laige number 
of students reported Government I as the most helpful course in its relations to 
Economics. 
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with Mathematics C is due to an inherent relation between 
Mathematics and Economics, or to the faet that both courses 
are highly systematic and demand continuous application 
of an analogous character? Neither condusion can be 
adopted without facing the faet that Economics A and 
Mathematics F show a correlation of only 40.3 (see Table 
XIV); Economics A and Admission Algebra of only 21.6 
(see Table XV). The facts reported in Section I of this 
chapter are also against either conclusion. If it can be 
shown that these correlations are low because of pecnliari- 
ties in the way marks are assigned in Admission Algebra 
and in Mathematics F, the conclusion that Mathematics 
and Economics are inherently related will be strengthened. 
In general, it may be said that Economics does not show 
any marked relation to any other field, but in this respect 
is probably not very diflferent from other coUege courses. 
On the other hånd it is much better in these respects than 
English A. The correlations of English A with History I, 
Philosophy A and Economics A are the lowest, with the 
exception of the admission subjects. Markedly low cor- 
relations give reasonable groimd for question as to the stand- 
ards of marking used, or the character of requirements, or 
both. The low correlations with admission subjects shown 
in Table XV, below, are of much significance, especially in 
view of the faet that high-school marks and college marks 
correlate much higher. (Cf . note to Table XV, and Section 
V of this chapter.) 

The following table gives the complete set of correlations, 
calculated by a modification of the rank-difference-squared 
method of Spearman, which, for reason discussed in Appen- 
dix B at the end of this Section, was considered to be appli- 
cable to these cases. It includes a nimiber of correlations 
with admission subjects, and these, it will be noticed, are 
all low on the list. 
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TABLE XV 
CoMPLETE List of Cosselations ^ 

PeRCSMTAOE or CoRKBLATION GIVSN by MbIHOD or RANK-DimESENCB — Sqvabxd 

n Pair of Connes p 



143 
182 

811 

167 

S 10 

263 

890 

276 

334 
346 
528 

387 
6897 

439 
432 
334 
114 
68 
20 
168 

3365 
3479 
3165 

341S 
42 
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Economics A vs Economic Theory 67 

Ph3rsics B or C VS Mathematics C or F 6x 

Economics A vs Economic History U. S 59 

Mathematics C 58 

Government x 56 

Money and Banking 56 

History i vs Government i 54 

German A or B vs Latin A or B 54 

Economics A vs German A or B 51 

Ph3rsics B or C 49 

History i 47 

Sociology 46 

Marks in Ec. A vs average in Other Economics . . 44 

Economics A vs Mathematics F 43 

Chemistry x 42 

Latin 4X 

English A vs History i 40 

" Philosophy A 31 

Economics A vs Admission Economics 29 

English A 27 

Admission Latin 26 

Algebra 2x 

Science 2x 

English 08 

Civil Government . . — .ox 
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P. E. Rank 
inp 


3 


X 


3 


2 


3 


3 


3 


4 


a 
3 


5 
6 


a 


75 


3 


7.5 


3 


9 


3 


xo 


a 


XI 


3 


xa 


X 


13 


3 


14 


3 
3 


IS 
16 


S 
7 


17 
18 


14 


19 


S 


20 


X 


21 


X 


22 


X 


23 


X 


24 


10 


25 



^ For puiposes of comparison with the coeffidents of correlation given above, 
some others based on similar materials may be mentioned. E. A. Lincoln, in a 
study published in School and Society for April 7, 191 7, fomid a correlation between 
the high school and Freshman mai^s of Hannud Freshmen of r » 67 +• The 
grades A, B, C, D, and E were given in this study the percentage values of 95, 
83, 68, 53, and 35. The results of Dearbom in the case of the ranks of 238 pupils 
from the Madison (Wis.) high school show a correlation with their standing in 
the Freshman year at the University of Wisconsin of r » 66.8. A general group 
of 472 pupils from several high schools showed a correlation between standing in 
high school and standing in the Freshman year at the University of r » 4-80. 
These studies, as well as that of Lincoln, aie correlations of average standing in 
several subjects, and are not directly comparable to correlation between single 
subjects. Rietz in a recently published study found a correlation of r» 0.528 be- 
tween the standing of 161 students in their college courses in Mathematics at 
Dartmouth and their standing in the Dartmouth Law School. 
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The only additional comment suggested by these tables 
concems the faet that Economics A correlates rather poorly 
with all other Economics courses taken together. This may 
be due in part to the faet that in this case a correlation is 
made between a single mark in the one course and an average 
of marks in other courses. There is, however, a more im- 
portant factor: the coefficient is based on the marks, 6897 
in aU, of students who took six or more half-courses beyond 
Economics A. That there is a somewhat arbitrary shifting 
of the grades of students between the elementary and ad- 
vanced courses has been pointed out in Section III. The 
low correlation depends chiefly on this factor. 

In order that the comparison in this case may be seen 
more in detail, the following tables, which show the per 
mille distribution of students by grade in the introductory 
and advanced courses, are added. 

The marks in the advanced courses are divided into five 
horizontal rows according to the grade in Economics A. 
Table (a) represents the distribution of 1000 marks in courses 
beyond Economics A of students who took six or more half- 
courses in Economics beyond Economics A. This is based on 
the actual distribution of 6897 such marks. 

Table (b) represents the distribution of 1000 marks in 
advanced courses in Economics based on the actual distri- 
bution of marks in four courses, Economic Theory, Money 
and Banking, Sociology, and Economic History of the U. S. 
There were 1604 in the actual distribution. 
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TABLE XVI 
Per Mille Distributions of Grades in Advanced Courses in 

ECONOMICS, COMPARED WITH THE GrADES IN EcONOMICS A 

(a) GsADES In Advanced HAUf-CouRsss ur Economxcs or Thosx Who Took Sdc 

OR More Beyond EcoNOiacs A 



Grade in 
Economics A 

A. 

B . 

C. 

D. 

E . 



A 

37 
30 
14 

2 

03 



B 

47 

137 
102 

8 

2 



C 

21 
125 
291 

48 

8 



D 

I 
x8 

63 

19 

3 



E 
o.x 

2 

IS 
6 

I 



Sums 
106 
312 

485 
83 
14 



83 296 



493 



104 24 



(b) Grades in Four Advanced Courses: EcoNomc Thsory, Monet 
AND Banking, Sociolooy, Econoiqc History 



Grade in 














Economics A 


A 


B 


C 


D 


E 


Sums 


A. . . 


. 54 


86 


27 


2 





169 


B . . . 


22 


133 


127 


16 


4 


302 


C. . . 


4 


76 


262 


81 


13 


436 


D. . . 


. 0.6 


IX 


44 


25 


5 


86 


E. . . 


0.6 





4 


a 


I 


8 



8x 306 464 X26 23 

In such tables, where the "base" is the same, comparisons 
can be readily made, since simple additions of certain col- 
imms, rows, or diagonals immediately give comparable fig- 
iires. For instance, comparable figiires for the "absolute 
retention" can be immediately foimd by adding the prin- 
cipal diagonals. For the general table the absolute retention 
is 485 per mille. For the fonr special courses it is 475 per 
mille. The "approximate retention" foimd by simmiing 
the adjacent diagonals is 424 per mille for the general table, 
and 443 per mille for the fonr courses. 

The sum of the changes in rank of the general table is 613, 
and for the four courses 614. The sum of the squares of the 
changes in rank is 823 for the general table, and 809 for the 
four special courses. The faet of larger sum of squares in 
the general table agrees with the lower correlation foimd for 
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the general set of marks in advanced courses than for the 
particular courses, since the correlation measure employed 
is based upon the squares of deviations from the average, and 
not upon the original deviations. 

The practice of the Department noted above (p. 49) 
appears clearly from Table XVI. In the general table, 172 
A^s and B's in Economics A were shifted a rank down- 
ward in the advanced courses, against 37 A's retained and 
30 B's advanced to A's; whereas 51 D's and E's were 
shifted a rank upward against i E retained and 6 D's 
lowered to E's. The facts are even more striking in the 
table for the f our courses. 



APPENDIX A 

In order to carry out the correlation studies, the results of which 
are presented in this chapter of the Report, it was necessary to assign 
numerical values to the grades of A, B, C, D, and E. The values em- 
ployed were as foUows: A = i; B = 2; C = 3; D = 4.5; and E = 6. 
Different values are given to D and E because it is believed that the 
step between C and D and the step between D and E are somewhat 
greater than the steps between A and B and B and C. Grades D 
and E penalize the student in the way of imiversity credits, etc, and 
they are, therefore, assigned, in general, more sparingly. In the case, 
for example, of 3863 grades assigned in Economics A, the percentages 
are as foUows: 

E D c B A 

2.98 1353 48.51 2555 942 

The imits adopted are admittedly only approximations. The at- 
tempt was made to calculate them more exactly on the basis of the 
relative frequency of grades assigned, but as the latter varies from 
distribution to distribution, the above approximations, for which 
there was also some justification in the percentile equivalents which 
are sometimes employed in the Recorder's ofBce, were finally chosen. 
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APPENDIX B 

A MODEPICATION OP THE SPEAMiAN RaNK — DIFFERENCE 

Squared Method op Correlation 

The formiila of correlation suggested by Bravais (1846) to which 
Pearson gave the name "product-moment" is based on the assump- 
tion that the variants in the two series of events in question, — in 
the present instance college marks in pairs of courses, — are each 
distributed according to a "normal" or Gaussian curve of frequency, 
or would be were a sufficient number of cases obtained. The correla- 
tion formulae by the method of ranks (or the order of merit of the 
individual in the group) as proposed by Spearman, assume a reet- 
angular form of distribution and also assume that the imit of rank 
which separates any two individuals or scores is the same or equal 
throughout the scale. Ih the Gaussian curve of frequency the dis- 
tances which separate any two individuals may be practically zero 
near the centre or mean of distribution, and very large at either ex- 
treme of the distribution. None of these various assumptions alto- 
gether holds for the five rank distributions of marks whidi are dealt 
with in this investigation. As indicated in Appendix A, the units of 
rank, in this case the distances between the grades A, B, C, D, and 
E, are probably not equal, and have been diflFerently evaluated for 
use in this study. The distributions of marks in college courses, — 
although for the most part asymmetricai, since more grades of A and 
B are given than of D and E, — approximate much more nearly the 
Gaussian or bell-shaped form of distribution than the rectilhiear. 
There is, however, some justification for using a rank-diflFerence 
method of comparison, since, as noted, the distances between the five 
ranks have been fixed in the assigning of numerical values. 

Both formulae assmne further that the general form of distribu- 
tion in the two series to be compared or correlated is the same or 
would be the same were there a sufficient number of cases. This is 
an assumption which ought to hold in many cases in the assignment 
of grades, e. g., the range or distribution of abilities of five himdred 
men in an introductory course in Economics will certainly not diflFer 
materially from their distribution in many other introductory courses, 
and espedally if all courses are equally open to free election. This, 
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of course, does not mean that the same men will hold the same ranks 
in the two subjects, but that if there are ten men of very superior 
(or A) rank, and fifty of high, but not superior (or B) rank, etc, in 
Economics, the same proportions should hold in, e. g., History or 
Government. In many of the distributions compared, however, this 
is not the case, and in some instances there are reasons why it should 
not be the case; whereas in other instances the distribution of marks 
can only be explained on the basis of arbitrary differences in the 
methods of assigning grades. 

This faet may affect the possible extent of correlation in a given 
pair of courses. The amoimt of correlation depends mainly, of 
course, on the number of changes in rank, e. g., if few, there is a high 
correlation, if many, a low correlation. If we suppose, in the above 
mentioned case, that from year to year ten men are given A grade in 
History, whereas but one man is given an A grade in Economics, it 
is evidently not possible for the ten highest men in Economics to 
secure the same rank as in History. Such changes in rank as these, 
which are caused by differences in the general form of distribution 
of grades, if these differences are purely arbitrary, should not be per- 
mitted to affect the correlation of the two courses — that is, the ex- 
tent to which men in one group maintain the same rank which they 
hold in the other. A modiffcation was therefore introduced into the 
rank-difference formula to discount or neglect differences in rank 
brought about in this way, and has been applied equally to all the 
pairs of courses compared. In some cases this is doubtless not fair, 
because there may be reasons which justify the distribution of grades 
employed. In view of this and other considerations mentioned above, 
it is not unlikely that the product-moment formula may give, on the 
whole, equally accurate correlations. 

The formula used was worked out by Mr. H. A. Sturges and is as 

SD^obt. — SD%iin. . 

follows: f) = I — c.T^o„ , r,TNg— ' ^ which SD^obt. = the sum 

SDnnax. + SDnnin. 

2 

of the actual differences in rank; SD%iin. = the sum of the differences 
in rank caused by differences in the forms of the distribution; and 
SD%iax. = the sum of the maximum possible differences. The differ- 
ences are in each case squared before simmiing. A similar modifica- 
tion of the product-moment formula might have been desirable but 
was not attempted. 
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V. EcoNomcs AND Admission Standing — Correlation 

OF Grades 

The correlations between admission subjects and Econom- 
ics were induded in the general table in Section III, above. 
They were, as there noted, the lowest of the correlations 
found. It is questionable, however, whether the figures 
really mean what they wonld seem to mean: namely, that 
there is little or no relation between the standing in school 
studies and university studies, or a given university study, 
such as Econoinics. There is, on the contrary, good reason 
to believe from other investigations that the relation be- 
tween the general standing in high school studies and imi- 
versity studies is dose.^ The low correlation here is due, it is 
believed, to the standards of marking which prevail in the 
entrance examinations.^ This may be seen in part in the 
lower averages of the grades assigned in the entrance exam- 
inations compared with those assigned to the same pupils 
in the Economics course. These averages are shown in the 
foUowing table, which gives also the correlations in terms of 
r (the product-moment formula). There is no reason why, 
in the case of such large groups of students as are listed in 
four of the comparisons, the average grade should not be the 
same in the two cases. 

^ Cf. W. F. Dearbom, Relative Standing in High School and University. 
Bulletin of the University of Wisconsin. 

* In a study published in School and Socidy for April 7, 191 7, £. A. Lincoln 
has shown that in the case of a considerable group of Harvard Freshmen, the 
relation between the standing of these pupils in high school and their standing in 
the university is much doser than the relation between their standing in the 
entrance ezaminations and their university standing. 
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TABT.K XVn 






Grades 


m EcoNOMics A Compabed with 


Grades of Admission 








IN Sdc Subjects 








in Aamissiim 


Admiasioii 


Average Grade 
in 




Nomber 


Study 


Study 


Economics 


r 


ao 


4.27 


Economics 


2.80 


21.8% 


3165 


3.08 


Science 


2.88 


17.3 


3365 


353 


Latin 


2.88 


T^S'S 


341S 


395 


English 


2.89 


13.1 


3479 


3.14 


Algebra 


2.88 


XI.8 


4a 


4.10 


Civil Gov. 


2.82 






In order that these comparisons of standing in the exam- 
ination subjects and the standing in Economics might be 
studied in greater detail, the results were also put into the 
form of distribution tables. For the purpose of this com- 
parison, the groups in question were in each case divided into 
five divisions according to their standing in the admission 
subject in question. The tables in the case of Admission 
English and Admission Latin are here given as examples. 
The first fifth of the group (nimibered i) are the students 
ranking highest, the second fifth are the students ranking 
next highest, etc. The group is then also divided into fif ths 
on the basis of standing in Economics A, and the tables are 
arranged to show how many of those who were in the first 
fifth of the grouping in the admission subject remain in the 
first fifth of the Economics grouping, and how many are 
shif ted into the second, third, f ourth, or even fifth divisions 
of the Economics grouping. 

The figures in black face t)^ show the cases of "ab- 
solute retention"; those who are shif ted but one division, 
either lower or higher, show the extent of "approximate 
retention." 
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Economics A x 

1 . . . S 

2 . . . s 

3 . . 9 

4 . . . 2 

S . . 



Totals 



Economics A x 
Z . . . 2 



TABLE XVra 
English-Admission 



35 
49 

54 
14 

4 



3 
X46 
29 X 

549 

13a 
35 



4 

135 
448 

911 

31a 

73 



2 . 

3 . 

4 . 



.6 
.6 



2 

iz 
6 
3 
3 
3 



3 

44 
35 

33 

27 

28 



5 

9 

4a 

Z12 

32 
II 



4 
41 

54 
56 

64 

59 



Totals 
330 
835 

1635 
492 

123 



Totab . 21 


156 


"53 


1879 


206 


3415 




Latin-Admission 






Economics A x 


a 


3 


4 


5 


Totftls 


z . . . a8 


8z 


143 


65 


6 


323 


2 . . . 20 


138 


372 


29Z 


20 


84Z 


3 . • 23 


17Z 


^5 


696 


61 


1596 


4. . . 6 


39 


183 


335 


22 


485 


5 . . . I 


6 


50 


59 


4 


Z20 



78 435 1393 1346 Z13 3365 
Engush-Admission 

PSRCEIHAGBS 



5 

3 
5 
7 
6 

9 



Economics A x 
z . . . 9 



2 . 

3 • 

4 . 

5 • 



3 

2 

z 



.8 



Latin-Admission 

PSRCENTAOES 



25 

IS 

10 

8 
5 



3 

44 
44 
40 
38 
42 



4 
20 

35 
44 
48 
49 



5 

2 

3 
4 
5 
3 



In the following table, the percentages of "absolute" and 
" approximate " retention ara shown for each admission 
subject in comparison with Economics A. They show how 
much shifting about there is, or in other words, how little 
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retention of position there is. This is, of conrse, the cause 
of the low correlations foiind. It can hardly be supposed 
that so much shif ting of relative ranks is due altogether to 
the difference between a college course and an admission 
subject, especially in view of the comparatively high reten- 
tion of rank as students pass from the high school to the 
college. Methods of marking in admission subjects are evi- 
dently in some degree at fault, or else, which is more likely, 
admission examinations offer at best only imreliable evidence 
of ability. 

TABLE XIX 
Percemtages of Absolute and of Afproximate Retention 



>cr cent. of 
Absolute 
Retention 


Per cent. of 

Approzimate 

Retention 


27 


72 


31 


79 


32 


77 


30 


73 


21 


62 


35 


60 



English and Economlcs 

Latin and Economics 

Algebra and Economics 

Science and Economics 

Civil Government and Economics . 
Admission Economics and Economics 



VI. Distribution of Grades m Four Advanced Courses 

CORRELATION OF GrADES AND AgES 

A. Distribution of Grades. The results of this study may 
best be presented by an interpretation of the accompany- 
ing graphs (Piates XI and XII). The courses in question 
are Economics A (for comparison), and Sociologyy Money and 
Banking, Econotnic Theory, and Economic History. The marks 
were taken from the records of students from 1902 to 1913. 
The number of cases considered was: for Economics A, 
3863; for Sociology, 463; for Money and Banking, 230; for 
Economic Theory, 144; for Economic History, 818. Dur- 
ing the ten years covered by our records 3080 men elected 
advanced courses in Economics, the elections in these four 
cases constituting 52 per cent of that number. 
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Plate XI shows the distribution of marks in Sociology 
compared with the distribution in Economics A and the 
combined distribution for all four advanced courses. There 
is an obvious trend toward the higher grades, although it is 
not striking. Plate XI also presents the same comparison 
for Money and Banking. In this case there is a trend toward 
the lower grades, about as clear as is the trend in the oppo- 
site direction in Sociology. Plate XII shows a very decided 
trend toward the higher grades in Economic Theory. In the 
case of Economic History (also on Plate XII) the trend is 
again toward the lower grades, but it is very slight. This 
course shows a distribution very closely in agreement with 
the joint distribution for the four advanced courses. 

It is natural to expect that grades in advanced courses will 
be somewhat higher than grades in the introductory course; 
but the divergence of the grades in Economic Theory from 
the joint distribution for the four advanced courses would 
seem to call for some explanation. It may no doubt be due 
in part to the smaU nimiber of cases considered, as com- 
pared with the nimibers in the other courses; and it is prob- 
ably due also to the faet that Economic Theory is known to 
be a difficult subject, which only the more able students 
choose. (Cf. Section III, above, p. 51.) In this course it 
would be especially worth while, however, to éxamine the 
standard of grading in the light of a knowledge of the grades 
in other courses secured by the men registered in it in any 
given year. 

B. Correlation of Grades and Ages. Piates XIII and XIV 
show in two ways the distribution of grades in Economics A 
to students of various ages compared with total distribu- 
tions selected from the 3863 cases. The first set of graphs 
compares the distribution of grades for six different ages 
with the normal distribution for the course. The second 
compares the range of ages for men receiving each grade 
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with the normal range of ages in the course — i. e., with 
the ages of all who took the course from 1902 to 1913. The 
graphs show clearly that yoimger men succeed more of ten 
and more fully than older men: in other words, the brilliance 
of the men who enter Economics A at an early age finds no 
obstacle in the character of the course. The course does 
not favor, much less demand, maturity. It is "geared" to 
18, 19, and 20. 

In the case of Sociology (Plate XV and Plate XVI) the 
same general result holds, although without quite so strik- 
ingly regular an advantage for the yoimger men. This 
subject cannot be said, however, to put a premiimi on delay 
in taking the course. A larger proportion of yoimg men 
than of old succeed in it. 

The same outcome, less clear, but not imcertain, appears 
in Money and Banking (Plate XVII and Plate XVIII). (The 
irregularity of the last figure on Plate XVIII is obviously 
due to the small nmnber of cases in question.) 

In Economic Theory (Plate XIX and Plate XX) the tend- 
ency of youth to win fuller success is not so clear. The older 
men are often at an advantage; at any rate, the course does 
not especially favor the yoimger men. 

Plate XXI and Plate XXII show that Economic Eistory 
pays almost no respect to ages. There is a slight advantage 
for men of twenty-three, but it is only slight. 

These graphs, taken together, corroborate the results of a 
previous study,*presented herewith among the Supplements 
to this Report (Supplement IV). Young men are not at a 
disadvantage in college merely because they are young; 
nor are they at a disadvantage on that account in advanced 
courses in Economics. If a student has proved his ability in 
Economics A, it would be unfair to discourage him from 
entering any of these courses because he happened to be 
nineteen or younger — although possibly he would do well 
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not to try Economics ii until a year or two later. Youth, 
in fine, is not of itself a handicap, and a yonng man who 
does well should never be passed by for academic honors or 
encouragement in favor of another who is his superior solely 
in years. Even the mature man who has gained in seri- 
ousness by several years out of college is likely to be less 
successful than the yoimger man who has never grown 
intellectually "rusty." 





CHAPTER IV 

MINOR STUDIES AND PROPOSALS FOR EXPERIMENT 

I. Habits or Study in Economics A and Other 

COURSES 

Habits of study among college students are often the sub- 
ject of discussion and comment, more or less serious, and 
every one knows, from his own experience and observation, 
more or less about them; but no conclusions or proposals 
conceming study, as the chief duty of college men, have ever 
been based, so far as we know, on a plain record of the 
actual practices of the students. This part of the Inspec- 
tion is based on a record of that kind — a record which 
might, indeed, be more extensive, but which is reliable as 
far as it goes. 

A member of the Division of Education presented to a 
section in Economics A and to a f ew other groups of stu- 
dents a request for records of all their studying from Decem- 
ber lo, 1913, to the end of January, 1914. The general 
purpose of the records was explained, although without 
reference to this Inspection; and the students were urged 
not to volimteer to supply records unless they were really 
interested in the problem imder consideration and could 
promise to make their records complete. Seven men from 
the Economics A section volimteered and fif teen men from 
other courses, one of whom, a Junior, was taking Economics 
2 a. The foiirteen men from courses in departments other 
than Economics did not all hånd in records of study for their 

full list of courses, so that this study is based on the eight 
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sets of records from Economics students, although the com- 
ments of the other students are also used in the brief final 
discussion. There was no attempt to make this study 
statistical in the sense which implies the counting or aver- 
aging of a large number of records. It was a study of a few 
selected cases, for the sake of securing sets of records limited 
in niunber but complete in character. 

As will be seen from the following record of marks, the 
men were not brilliant; but all were faithful and serious in 
their attitude. 

Mid-Year Grades — 1913-14 

Student Economks A Other Couzaes 

1 D-f £nglish2:B. Philosophy irC-f. French3: A— 

2 D+ Classical Philosophy 66: B— . History loa: B. 

Comparative Literature 9: A— . English 24: 
C—. History 14: C—. 

3 D— English 27; C. Latin 10: 0+. Music 4: D. 

Social Ethics: 4: B— . Music 3: B— . 

4 C-f- English 22: C. English 2: D. Physiology i : B. 

5 C-f- Engineering 3: B+. Mathematics 5: B-j-. En- 

gineering 41: B+. Phjrsics i: A. 

6 C French 9: B— . Comparative Literature i: C. 

Spanish 5: C-f-. Government 17: C. 

7 B Chemistry 3: B. Mineralogy 2: B. Geology 8: 

A— . Geology 10: A. 

8 (Ec. 2a) C German A: C-f-. History 30a: C. History i6a: 

B. Education A: A. 

The following letter and sample record sUp was sent to 
each of the volimteers. 

Cambridge, December 8, 1915. 
My D£AR Mr. 

You are among those who gave me their names in responsa to my 
recent request for co5peration in securing accurate records of the 
study habits of college men. I take for granted, after what I said at 
that time, that I may now rely on you for a serious and faithful effort 
to supply me with the data I am seeking. Let me repeat the assur- 
ance that the facts you record will be used only impersonally, as a 
basis for general conclusions, and without the slightest reference to 
the name of the recorder. Your own records will be open at any time 
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to your inspection, in 5 Lawrence Hall, and I shall be glad to confer 
with you, if you care to have me, on your methods of study or on any 
educational questions which this record may suggest to you. 

You will find enclosed slips on which the records are to be made. 
In making yoiu: records please observe very carefully the following 
points: 

I. Make a separate record for each distinct "piece" of study. 
That is, if you tum from one topic to another in the same 
course, or from one kind of work to another in the same 
coiurse, or from the work of one course to the work of another 
course, make a separate record for each. 
II. Record every piece of study inunediately at the completion 
of it, or as soon thereaf ter as possible. The purely mechanical 
details of the record may be set down at the beginning of the 
study, and the rest fiUed out at the end of it, with the ex- 
penditure of very little time. 
III. Be absolutely frank in filling out the records. The back of 
the slip may be used for conmient, if the space allotted on the 
front of the slip is not sufficient. 

The enclosed slips need very little explanation. You will find one 
of them filled out as an example. Please let me know at once if you 
discover any difficulty in filling out the slips. You may find me in 
Lawrence 5 any day at eleven, or you can reach me there by tele- 
phone or mail. The enclosed slips are intended to cover the work 
of a week. I will mail to you a similar set of slips every week. The 
addressed envelope with the slips is for the retxim of the week's records. 
Please mail them on Saturday so that I may receive them Monday 
morning. Your first set of records should be mailed Dec. 13. 

Under the heading "Material" please give the exact pages covered 
in your study when this is possible; if not, record in some way the 
extent of the material you used. Please note that laboratory work 
and field work should be covered in these records. In such cases make 
a brief statement, under the heading "Material," of the character of 
the work. A piece of mechanical drawing in an Engineering course; 
an experiment in a Physics course; a laboratory test in a course in 
Chemistry; a visit to an institution in a course in Government; these 
are all examples of forms of study, the character of which should be 
recorded under the heading. 

It may also happen that the work to be recorded will be writing, 
or organizing material for writing. These facts should also be noted 
under the heading "Material." 

Under the heading "Purpose" please state whether the work is 
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done under the general requirements of the course, as a part of the 
regularly assigned reading, in special preparation for a set examina- 
tion, or for any other particnlar purpose. 

Under "Method" record simply the outstanding facts as to your 
procedure. If you memorize headings or take notes on reading, or 
just read straight ahead without pausing to organize the material, or 
work over material you studied into a special form of organization 
for your own purposes, please indicate the faet briefly in your record. 

Under "Comment" please put down in any case your own reaction 
as to the value of the time you spent. If you feel sure that you have 
grasped the material and can remember it, use the term "satisfactory " 
or some similar term. If the work required seemed useless to you, if 
you foimd no profit in the book you were studying, if the work you 
did conf used rather than darified your ideas — please make an ap- 
propriate record. Under this heading I should be glad also of indication 
of interruptions or distractions which you encoimtered in your work. 

With the hope that your cooperation in this study will yield some- 
thing to you as well as to others, I am 

Very sincerely yours, 

Sample Slip 

Name: Doe, John H. Course: Economics A. 

Daie: 6 Dec., '13 Hours: 3:30-4:30 Place: Upper Mass. 
Material: Taussig: Prin. Econ., Ch. 32, pp. 449-467. Chapter on 

Foreign Exchanges. 
Purpose: Regular weekly assignment. 
Methoi: ist reading for general impression; then outlined by sec- 

tions and paragraphs. Spent 10 minutes memorizing a simi- 

mary, and 20 minutes thinking out tjrpical cases. 
Comment: 1 imderstand the chapter, but need opportimity to 

follow the details of exchange as actually practised. 

The several sets of record were summarized, both for the 
more mechanical matters and for methods, comments, and 
general impressions, as shown in the f ollowing example : 

Set I 

(a) Number of records submitted — 119. 

(b) Time spent in study: 

Economics A . Study, on 16 different dates, amoimting to 52 hours. 
English 2 . . . Study, on 20 different dates, amounting to 58 hours. 
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French 3 . . . 

Philosophy i . 

(c) Piaces: 

Economics A . 

English 2 . . . 

French 3 . . . 

Philosophy i . 



(d) Purposes: 
Economics A . 



English 2 . . . 



French 3 . . . 



Philosophy i . 



Study, on 12 different dates, amounting to 39 hours. 
Study, on 12 different dates, amounting to 30 hours. 



College room (Stoughton), 13 periods; Massa- 
chusetts Hall, 9 periods; home, 2 periods; Pi Eta 
Library, i period. 

Massachusetts Hall, 19 periods; college room, 8 
periods; home, 8 periods; on trains, 3 periods; in 
dining hall, i period. 

Home, 36 periods; Pi Eta Library, 9 periods; col- 
lege room, 6 periods; Massachusetts Hall, 4 
periods. 

College room, 15 periods; Massachusetts Hall, 9 
periods; Pi Eta Library, 4 periods; home, i 
period; on trolley cars, 4 periods. 



For midyear examination, 12 periods. 

For weekly assignments of reading, 11 periods. 

For review preparatory for section meetings, 2 

periods. 
For midyear examination, 24 periods. 
For lesson of succeeding day, 11 periods. 
For fixing memory passages, 4 periods. 
For midyear examination, 7 periods. 
For lesson of succeeding day, 9 periods. 
For review of preceding lesson, 6 periods. 
For midyear examination, 29 periods. 
For supplementary and advanced reading, 2 periods. 
For making up lecture lost, i period. 
For section meeting, i period. 



This man studied every day from December 10 to Decem- 
ber 18 inclusive, and from January 6 to February 7 inclusive. 
He scattered his periods of study throughout the day, from 
8 A.M. to 2 P.M., but studied more from i to 5 p.m., and from 
8 to 12 P.M., than at other hours. Some of his periods of 
review for midyears were long — one day of "cramming" 
for Economics A including an hour and a quarter in the 
morning, four hours in the aftemoon, and five hours in the 
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evening. The commonest length of his periods was an hour. 
He often recorded periods of ten or fifteen minutes. On one 
day he spent five hours at diflferent times on assigned reading 
in Economics A and remarks, "Toward the end my brain 
seemed tired of Economics, and while I could pick out the 
point, it did not seem as vivid." Several records note that 
study late at night "af ter a Symphony concert" is "imsatis- 
factory." 

His method of study in Economics A was good: he read 
the whole chapter or section first for a general impression, 
and reviewed it paragraph by paragraph to fix detaUs. Acts 
and scenes in Henry IV for English 2 he håndled in the 
same way. His method of memorizing for English 2 was 
more doubtful: he memorized two or three lines at a time, 
adding them to what he already knew. In Economics A 
he committed outlines to memory and he took notes on all 
his reading in Economics and Philosophy. In French he 
made full use of the dictionary, recording such work as 
"tedious" but noting the pleasure he secured afterwards 
in rapid rereading of the text. He seldom went over any 
assignment less than twice, often covering a difficult assign- 
ment three times. Once he records that in taking notes he 
"made an extra effort to use his own language and seemed 
to get more out of it." 

This man's records give a clear impression of faithful 
effort spent almost wholly in memorizing. He never dis- 
cussed problems in Economics or Philosophy with himself or 
— so far as his records show — with others. His study was 
bookwork — leaming what the text and his reading notes 
and his lecture notes presented. He never records the least 
dissent from what he read, although he sometimes foimd it 
"dull"; nor does he record any enthusiusm higher than 
"interest." His chief desire, in his own phrase, is to "get 
a firm grip on the material." 
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The other sets of records may best be summarized more 

briefly. 

Set 2 

Number of records submitted — 131. 

This man studied daily form December 10 to December 
18, read much during the vacation and studied dafly from 
January 5 to February 6; but he often studied in short 
periods of ten, fifteen, or twenty minutes, on one occasion 
tuming from one subject to another and back again in the 
course of an hour. He studied mostly in the late af temoon 
and evening. His longest period of consecutive work on one 
subject was four hours and a half in History 10 a. His study 
was continually interrupted and very often casual and 
hurried. 

There is little to indicate any fixed method, either in 
general or for any particular course. He often records 
thinking about the subject before beginning his work, and 
he usually marked or reread significant passages. Once he 
records marking the topic sentences in all the paragraphs 
in a long chapter assigned in History 14. A very common 
remark is to the effect that he got a f ew good points but no 
unified impression. Much of his study has reference to 
written work in preparation, the subjects of which he had 
constantly in mind. Apparently he did considerable think- 
ing as he studied, retaining of what he read chiefly the 
material which wove itself into his own thought. On the 
occasions when he f oimd time for review, he notes especially 
the striking improvement m his understanding of the pas- 
sages as wholes. He notes occasionally his disagreement 
with the author he is reading. 

This set of notes shows much greater activity of mind on 
the part of the student than does the first set. He estimates 
values, organizes materials for use, and picks out ideas which 
interest him. But he works erratically and does not wrestle 
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with problems or cases in point. Economics as a subject 
seems less congenial to him than other subjects, for in 
Economics he suffers more from his tendency to "browse" 
in the subject rather than to concentrate his attention on a 
connected series of problems. 

Sets 

Nimiber of records submitted — 71. 

This man studied in periods of considerable length, con- 
centrating on single subjects. He worked daily from 
December 10 to February 6, omitting Simdays and the full 
Christmas vacation. One record shows study in Social 
Ethics from 1 130 p. m. to 6 p. m. and the next record shows 
study in the same subject that evening from 7 p. m. to 2 A. m. 
This was reading and writing for a thesis and is recorded 
as "intensely interesting work." Periods of two and three 
hours are common. The work fell more often in the after- 
noon than in the evening. 

His method in Economics "is always the same: reading 
for impression, then making a brief." In general, he found 
his reading in Economics easy and sometimes interesting; 
but he evidently did it somewhat perfimctorily. His work 
on Immigration in Social Ethics 4 fascinated him. In this 
course his mind was generally active: he prepared for the 
examination by "considering possible questions and making 
answers for them," a method which might seem like the 
most mechanical "cramming" if it were not for the evidence 
of the other records, which show that he was thmking for 
himself in the subject. His mark in the Course, (B— ), the 
highest he received, reflects this. In preparation for Eco- 
nomics A he read his notes through once and memorized 
diagrams and topic headings. 

His records give a general impression of application 
faithful enough, but never intensive except where personal 
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interest is aroused in connection with a piece of constructive 
work. He is content to understand what he reads, without 
any strong puipose to possess it, still less to ponder it as a 
matter of real conæm — unless he can use it as part of his 
preparation for a theme or thesis. He is the sort of man who 
can best be awakened mentally by the pressure of a practical 
problem or task, seldom by the mere exposition of faet or 
theory in book or lecture. 

Set 4 

Nimiber of records submitted — 75. 

In Engineering Sciences 16 and Mathematics 2 b, both 
courses in which this student was registered during the jirst 
half of 191 2-13 and the second half of 1913-14, he spent 14 
hours of study, in all, from December 10, 1913, to February 
6, 1914. His final grade in Mathematics 2b was C—; in 
Engineering Sciences 16, A. In Mathematics C and Physics 
I he helped a f riend four times, aggregating about 3^^ hours. 

Student 4 spent much less time in study than Students 
I, 2, or 3. He did no studying on seventeen college days 
during the period from December 10 to February 7, except 
for certain "outside" work during the Christmas vacation: 
thus he lost about 20 days out of 56. He sometimes studied 
early in the morning — on one occasion from s to 8; and 
often he studied in the forenoon between 9 and i. His 
longest consecutive study came in the evenings, often 
between 10 p.m. and i p.m., but in general his periods were 
short — usually half an hour or less. 

In Economics he just "reads," remarking once that the 
material is "interesting," but that he "will rely in the test 
more on his own reasoning than on the words of the text." 
He worked out volimtarily a few nimierical solutions for 
economic problems and foimd it "useful drill." Also he 
records "thinking out applications of the principles" pre- 
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sented in the text. Anything in mathematical or scientific 
form appeals to him, but in writing English themes his 
thoughts "do not come freely." In English 2 he foiind 
"writing out passages a great help in memorizing." In 
English 22 he "gets started" slowly, only once recording 
rapid work on a theme, when he wrote "an indignant attack 
on a theme read in class." He always carefully rewrites 
thémes, but never takes notes on reading. He records that 
in beginning a book he always reads it through hurriedly 
first "for a general impression." 

This student's mind works practically: he does best in 
the face of problems, objects, figures, examples; and in 
discussion and exposition. This is indicated by such records 
as the f ollowing : 

Date: Week of Dec. 29. Hours: 3:00-11:00. Place: B. & W. 
Power Station. 

Comment: 1 derived great benefit from this vacation work which 
will help me in my Engineering. I was able to see the application of 
what I had leamed in class. I found out a great many new things 
for myself and freely asked questions. The engineers were very kind 
and showed me what they could. I picked up a good idea of the gen- 
eral routine work and repair work. It was of much more value than 
a week's work in class. I leamed a great deal which is never men- 
tioned in class. One oiler trained me on examination questions. I 
spent some time computing data about the engines. 

The contact with the men was of great profit as I believe that it 
is important for an engineer to know how work looks from the work- 
man's point of view. 

If you wish I would gladly report on other vacation work I have 
done which has helped me. 

Date: Jan. 5, '14. Hours: 11:15-12 m. Place: 53 Dunster St. 

Material: Carhart's College Physics. Chapter on calorimetry. 

Purposé: Helping a friend prepare for exam. 

Method: Working and explaining problems. 

Comment: Helps me to keep my hånd in on work that I have 
finished and which I shall need in my Engineering. It is my habit 
to spend time helping my friends. I shall report that imtil you re- 
quest only my own work. 
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Date: 1/8/14. Hours: 10:15-11 :cx5 p. m. Place: 53 Dunster St. 

Material: Carhart's College Physics. Calorimetry. Dew point, 
Triple point Hmnidity. 

Purpose: Helping a friend. 

Method: Explained the text and enlightened dark piaces. Assisted 
with the problems by giving hints and suggestions, also made sure 
that he imderstood principle. 

This work refreshed my memory of physical constants. Also it 
was good practice in exposition and clearing up misimderstanding. 
The Triple point was also new to me. I had to catch on to the ideas 
and explain after one reading of the text. Trains mental alertness. 

Date: 1/3/14. Hours: 2:00-245?. m. Place: Room. 

Material: Original thought. 

Purpose: Request from railroad fireman for explanation of 
"Linkhig up." 

Method: Developed engine cards from Zenner diagram; plotted 
work cards and torque of locomotive through complete cycle. 

Comment: I find original work like this of ten of much more value 
than dass work. It is good practice in deduction from apparently 
imrelated facts. It develops reasoning power and confidence that 
when I do strike a problem that is not taken up in any text book I 
have seen, I stand a good chance of solving it. This increases re- 
sourcefulness. The results are often of great help in class and at 
work. 

(Note): Do you wish work that falls in no course to be reported? 

Daie: 1/10/14. Hours: 11:00-11:15 p. m. Place: Home. 

Material: Original thought. 

Purpose: Proof that a three-phase current could be transmitted 
over three wires. 

Method: Derivation of formula. 

Comment: Very useful training. Makes me more independent of 
the text book. The suggestion came from a diagram of a three- 
phase current and three-phase transformer. The result is that I 
have a clear conception of what such a current is which I never shall 
forget. 

Date: 1/12/14. Hours: 9:00-10:15 p. m. PUice: 53 Dunster St. 

Material: Class problems in projection of one line on another in 
space. 

Purpose: Helping a friend. 

Comment: Very good training and think quickly in working out 
problems. Knocks the rust oflf of my analytic geometry. 
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Date: 4/5/14. Hours: 9:oo-i2:cx5 m. Place: Westmoreley 106. 
Material: Friendes notes. 
Purpose: Exam. 
Method: Mutual explanation. 

Comment: I think this a very good way to prepare for an exam. 
Seminars of two or three should be gathered together to talk. 

Sets 

Number of records submitted — 80. 

Student 5 missed seventeen days out of 46, including 
eight days in the Christmas vacation. He used every hpur 
of the day, from 8 a. m. to 1 130 A. m. His periods of study 
are of reasonable length, ranging commonly from three- 
quarters of an hoiu* to two hours. 

This student was more intelligent and thoughtful than 

diligent. His comments show mdependence and critical 

power, but he does not do his work with great care or per- 

sistence. In Economics he "reads once" and "thinks over 

the important points." In Mathematics and Physics he 

works with a friend, doing problems, comparing notes, and 

asking or answering questions. In English he gets clear 

impressions from a single reading. He is frank in his 

criticism of books and chapters but takes the easiest way 

in study. 

Set 6 

Nxunber of records submitted — 34. 

This student missed 27 days out of 44, including the whole 
period (17 days) between December 18 and January 5. He 
studied in the af temoon and evening, seldom in the mom- 
ing. His periods are most of ten only twenty or twenty-five 
minutes in length. 

He slights Economics most, often reading a chapter in 
ten minutes. In reading he takes notes when he has time. 
He has no conscious method of study except in Spanish, in 
which he visualizes sentences in composition and leams one 
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sentence at a time in that way. His comments show that 
he takes study without much thought : if he understands at 
first reading he calls the period " satisf actory " ; if not, he 
remarks, "Too difficult, so gave it up." 

Set 7 

Number of records submitted — 30. 

Student 7 missed only two days, except for the period 
from December 19 to January 6, during which he did not 
study. He always studied in periods longer than an hour, 
usually for at least two hours — but many of these periods 
were in the laboratory. 

In Economics he reads hastily, and records that "it needs 
to be done over again." In other courses he tends to hurry, 
but checks himself , starts over again and goes more slowly. 
When he has objects or diagrams or specimens before him he 
is satisfied with his results, seldom otherwise. On one slip 
he remarks, conceming "original data on Coral Reefs of 
the Philippine Islands" of which he made a topical outline, 
"Fair. But I would like to return to the Philippines and 
see the reefs again!!" He is not conscious of his methods, 
but does his work steadily, in the handiest way. 

Sets 

Nxunber of records submitted — 98. 

During a period of 68 days this student did no stud3dng 
on 23. (He was a married man, although an imdergraduate.) 
He of ten studied from 5 to 6 in the morning, and in general 
did most of his work in the forenoon, none af ter 11 at night. 
Most of his periods are haK or three quarters of an hour in 
length, although on the paper in Education A he worked 
continuously for six hoiu-s, and on his thesis for History i6a 
for four and a half hours. 
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Student 8 was by far the most self-conscious in his study- 
ing, of the men m this group. He tried various experiments 
— reading aloud, listening to reading aloud, abstracting 
before study and after study, choosing topic-words for a 
set of cards to be nm over at odd moments, making digests 
of notes taken by another man, testing his memory of topics 
chosen at random, thinking carefully on selected problems, 
visnalizing vocabularies, etc. His best results came from 
the time he spent on organizing materials in outline form 
and fitting illustrative details imder appropriate headings. 

These records give strong support to a common impression, 
namely, that college students are engaged for the most part 
in preparing for exammations, tests, and papers and seldom 
look beyond these immediate objectives. The questions with 
which lectures and text books deal are not real to them. Their 
practical business at the moment is to "pass the course." 
Any and all methods and devices which can be used to make 
them f eel the reality and significance of the problems they 
are studying ought to be adopted, even at great risks. 

As to methods of study, the records show that students 
are largely innocent of any knowledge of the dififerent 
requirements of dififerent tasks. They seldom think out 
cases, problems, exceptions, contrary positions, applications, 
or corollaries. They try to imderstand, fix the material in 
mind, pick out the important points. Instruction in study 
is needed and specific directions for particular pieces of work. 

The evidence in this section agrees admirably with the 
evidence from the questionnaires, from our visits, and from 
other minor studies in supporting the general conclusion 
that there is great and imnecessary waste of time in college 
work. Much of it could be prevented by more careful 
attention on the part of instructors to the problems of 
teaching as such — not merely to modes of presentation in 
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class, but to the guidance of individuals in their leaming. 
To make this possible, however, the University must first 
change its method of estimating the work a teacher ought to 
carry. The only just way to determine the burden of an 
instnictor who is to work individually with his student is 
to use as a unit the "student-hour," with such adjustments 
as the varying character of courses may suggest.^ 

II. Preparatory Questions in Economics A 

This section reports the only experiment in method in 
which we were able to secure quantitative retums of any 
sort, and in this case we should have been glad to conduct 
a more elaborate experiment to test the conclusions here 
reported. The other experiments we hoped to carry out, 
on two of which work was begun, are discussed in the 
foUowing section. The experiments are reported not to 
present results of value in themselves, for they jdelded none ; 
nor to exemplify method in any of its refinements, for our 
method was only generally soimd and the results should 
have been checked in a niraiber of ways; but to show the 
possibUities of experiment and the kind of questions it can 
be applied to. 

Professor Day had had in mind for some time the possible 
advantage of giving to students in Economics 'A questions 
and problems to be considered in advance of the reading, 
without any requirement of written reports on them, the 
questions being intended simply to sharpen the students' 
interest in their subsequent study. The results of this 
experiment were taken to support the use of such questions, 
and Professor Day and Dr. Davis later published their 

^ See Birge, £. A. " How Many Hours a Week Should be Required of Teachers 
in a University?" TransacHons and Proceedings of the NaUonal Association 
of the State Universities, v. Mt ^916, 
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volume of Qtæstions in Economics in order to continue the 
policy. In 1913-14, preparatory questions were used in all 
sections of Economics A, and it was proposed in that year 
that af ter December 10 the use of these questions should be 
omitted in all but a few selected sections for the sake of 
testing in a new way the effect of their use. It was also 
proposed that the relative advantages of "scientific" and 
"popular" questions should be tested by using the latter 
with certain sections and the former with others. These 
proposals, however, could not be carried out satisfactorUy, 
owing to lack of time. 

The foUowing report on the methods and results of this 
experiment was presented at the joint conf erence on October 
29, 1913. 

Method and Results in an Experiment with Preparatory 
Qtæstions in Certain Sections of Economics A, i gi 2-1;} 

In Economics A, the assigned reading is given out at the Saturday 
lecture. In the section meetings of the following week (Monday to 
Friday), the reading thus assigned is discussed. Each lecture covers 
the groimd of the reading assigned on the previous Saturday. At 
the first section meeting of the week, a twenty-minute test on the 
reading and the lecture of the previous week is given. 

It seemed clear that a list of questions, given out before the as- 
signment of the reading and designed to stimulate the curiosity and 
challenge the interest of students, might make their reading more 
profitable and their comprehension and memory of it and of the lec- 
ture more complete. Such questions would constitute a device to be 
used in preparing the minds of the students for the facts and concep- 
tions presented in the reading and the lecture, and in arousing and 
directing their attention. Professor Day suggested that such ques- 
tions be given out in certain sections and not in others, beginning in 
February, 1913, and that the records of sections with which the ex- 
periment was tried be compared with the records of the control sec- 
tions throughout the spring and on the final examination. The 
results presented below show that in most cases the preparatory 
questions were of some profit in the preparation of the weekly papers; 
but the retums from the final examinations are variable and incon- 
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dusive. A few shiftings from section to section late in the second 
half year accoimt for this in part; and the faet that the results in the 
examination differ so markedly from the results in the paper shows 
how sharply examinations and daily work are separated. It will be 
noted, however, that it was only Section M which forged ahead of its 
competing "favored" sections — a faet for which we fomid no ex- 
planation. The general experience of the two instructors who used 
these questions was in favor of them, and a nimiber oi students ex- 
pressed their interest in the questions and their belief tbat they had 
been helped by them. 

The character of the questions used may be seen from the 
foUowing examples: 

1. Rents in Harvard Square are lower than on Washington Street 
in Boston. Would you expect prices for the same articles to be less 
at Harvard Square? Why or Why not? 

2. Is the existence of a leisure class supported from economic 
rent socially justified? Do you find any valid objections to state ap- 
propriation of all such rents? 

3. Wherein are rent and monopoly gains alike, wherein diflferent? 

4. The total annual rental of a house and lot is $5000. The value 
of the house is $40,000. Repairs, depredation, and Insurance cost 
Siooo yearly. If the current rate of interest on investments of equal 
security is 5 per cent, what is the value of the lot? 

5. Is the spendthrift a public benefactor, in that he increases the 
demand for labor? 

6. What is meant by the "discoimted marginal product of labor"? 

7. What is the cause of the dedining birth rate in advandng 
countries? Would this cause operate under sodalism? 

8. Are the rich becoming richer, and the poor, poorer? 

9. Can tråde imions increase general wages? 

10. What is meant by "charging what the traffic will bear"? 
Would you expect the railroad rate on a ton of copper to be higher or 
lower than the rate on a ton of coal? Why does an express company 
charge no more for carrying 25 Ibs. of books than it does for canying 
the same distance at owner's risk 25 Ibs. of table silver? 

11. Enumerate all the public service Industries you can think of. 
Will the distribution of milk ever become a public service industry? 

12. What is unfair competition? Is the following unfair competi- 
tion? — To refuse to sell to any retailer who will carry rival lines of 
goods? 
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Professor Day's Sections 

Sect. E Sect. K 

Mid-Year Examination . 60.4 65.3 

Paper 68.2* 70.9 

68.8 759* 

" 71-6* 73.3 

" 75-5* 76.8 

Average 71.03 74.23 

Final Examination . . . 69.9 73.5 

* Given preparatoiy questions. 



Favorable 
effectof 
Difference Prep. Questions 


4.9 




2.7 


2.2 


7.1 


2.2 


1.7 


3-2 


1.3 


3.6 


3.2 


2.8 


4.6 


.3 



Mr. Burbank's Sections 



Mid-Year Exsunmation 
Paper 



Average .... 
Final Examination 



Sect. D 
62.6 
70.1 

58.5 
65.7 
72.6 

69 
73-2 
68.18 
68.04 



SectM 

59.1 

65.5 

56.7 
63.2 

68 

64.7 
68.1 

64.37 
71 



Favorable 
effect of 
Difference Prq;>. Questions 



3.5 
4.6 

1.8 

2.5 
4.6 

4.3 

5.1 
3.82 

2.96 



i.i 

1.7* 
I. * 

I.I 

.8 

1.6 

.32 
6.46* 



In each case the preparatoiy questions were given to Section D. 

* Unfavorable 



Mr. Burbank's Sections 



Mid-Year Examination 
Paper 



Average .... 
Final Examination 



Sect. G 
60.3 

69.3 

56.7 
69.2 

70.1 

67.5 
72.6 

70.3 
67.96 

67.15 



Sect.P 

65.3 
70.1 

58 
68 

73.8 

73.1 
71.8 

69.7 
69.21 

70.44 



Favorable 
effect of 
Difference Prep. Questions 



5 
.8 

1.3 
1.2 

3.7 
5.6 

.8 

.6 
1.26 

3.29 



4.2 

3.7 
6.2 

1-3 

.6* 

5.8 
5.6 

3.74 
1.71 



In each case the questions were given to Section G. 

* Unfavorable. 
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Mr. Buxbank's Sechons 



Mid-Year Examination 
Paper 



Average 

Final Examination . 



Sect. D 
62.6 
70.1 

58.5 

65.7 
72.6 

69 

73-2 
68.18 

68.04 



Sect. P 

65.3 
70.1 

S8 
68 

73.8 

73-1 
71.8 

69.21 

70.44 



In each case the question was given to Section D. 

• Unfavorable. 



Favorable 
effectof 
Difference Prep. Questions 



2.7 

S 

2.5 
Z.2 

4.1 

14 

Z.18 

2.4 



2.7 

3.2 
.2 

i-S 
IA* 
4.1 
1.72 

.3 



Mr. Burbank's Sechons. 

Favorable 
effectol 
Sect. G Sect. M Difference Prep. Questions 

Mid-Year Examination . 60.3 59.1 1.2 

Paper 69.3 65.5 3.8 2.6 

" 56.7 56.7 — 1.2* 

" 69.2 63.2 6 4.8 

" 70.1 68 2.1 .9 

" 67.5 64.7 2.8 1.6 

" 72.6 68.1 4.5 3.3 

" 70.3 69.2 1. 1 .1* 

Average 67.96 65.57 3.38 1.7 

Final Examination . . . 67.15 71 3.85 5-05* 

In each case the question was given to Section G. 

* Unfavorable. 

Average favorable effect on the papers, 2.81 in 24 cases. 
" mifavorable " " " " i. 6 cases. 

** favorable " '* ** final examination, .77 in 3 cases. 
" mifavorable " " " " " 5.75 in 2 cases. 

The results of this experiment were not in themselves con- 
vincing as to the advantage of preparatory questions, yet 
they have some weight in corroboration of the general 
observation and opinion of the instructors. The only 
possibility of systematic error in the marking lay in the 
temptation which the instructors might have felt to give 
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higher marks to the students in the sections using prepara- 
tory questions. But the marks on the papers and on the 
final examinations were not given, of course, to the students 
of the various sections as groups, but as individuals, and it 
seems unlikely that any imconscious tendency to mark the 
students of one section higher than those of another could 
have exerted an influence strong enough to overcome 
conscientious efiFort to assign marks accurately. For the 
comparisons, a broader basis than the average standing of 
sections in the mid-year examinations should have been 
secured; and the preparatory questions should have been 
used for a considerable period with one section and then 
with the other. 

III. Proposals for Experiment in Method 

The first proposal for experiment in method was made 
in February, 1913. Economics A was then concemed with 
the subject Interesty and it was agreed that in one section 
the students should omit reading the passages in the text 
and instead look over the financial sheet of the morning 
paper to 'find the rate of interest and what quotations give 
the dearest indication of it. On the basis of this more or 
less practical contact with the facts of the matter, discussion 
was to bring out the principles necéssary for a completer 
imderstanding of the topic. In another section the usual 
procedure was to be followed, and the performances of the 
two sections on the subsequent dass paper were to be 
compared. The more inductive procedure, starting from 
the study of facts presented in a way already partly f amiliar 
to most of the students, might, it was thought, yield better 
results by arousing greater interest and attention. The 
results of this experiment were to be combined with the 
results of similar experiments with inductive teaching, in 
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each case a "control" section giving the necessary basis 
for comparison. Unf ortiinately, a mistake in the assignment 
of the work made it impossible to compare the performances 
of the two sections on Interesty and the experiment with 
preliminary questions took most of the time we conld give 
to this phase of the investigation thereaf ter. 

The next fall, however, an attempt was made to conduct 
an experiment in the leaming of a set definition. At a 
conference of instructors and assistants in Economics A, it 
was agreed that three of the men in charge of sections shonld 
attempt an experimental determination of the value of the 
careful leaming of a fixed definition. Each of these in- 
structors agreed to teach the definition of Marginal Utility 
in certain sections and not in others. The procedure agreed 
upon was as follows: The general conception was to be 
discussed in class in the usual fashion by question and 
answer, but before the close of the hour the instructor was 
to ask for the definition of Marginal Utility ^ and this was 
to be put on the board. The definition as given was to be 
criticized and corrected and the definition agreed on by 
the instructors was to be substituted on the board for any 
less adequate definition suggested by the students. The 
definition as prsented by the instructors was to be leamed 
by heart by the students and their exact recall of it tested 
in a subsequent section meeting. The advantage of this 
procedure was to be compared with the advantage of teach- 
ing this topic without the leaming of a set definition, by 
means of a question to be answered in the fall hour-examina- 
tion. This experiment failed because the instructors did 
not succeed in saving timie enough for the teaching of the 
definition. Only one foimd himself in a position even to 
report his results. 

Experiment in college teaching demands a great deal of 
time and close attention to detail. There are so many 
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possibilities of error, means of Control are so difficult to 
apply, and conclusive tests so hard to devise, that some 
experience, to say nothing of time, energy, and purpose, is 
necessary to carry an experiment to a profitable conclusion. 
We believe this can be done, however, and that in many 
cases in which the value of a particular method is in dispute 
it would pay to attempt it. There is no good ground, to be 
sure, for the hope that experiment in this fidd can be made 
so exact as to banish forever all possibility of dijøfeirence of 
opinion. The complexity of the action to be controlled, 
the impossibility of eliminating hidden factors, and the 
barriers to observation of results are all such as to make 
dubious the expectation of final conclusions based solely on 
experiment. Yet the effort to secure returns more exact than 
those of unrecorded and unchecked observation cannot but 
yield a valuable result. It will at any rate sharpen observa- 
tion and concentrate attention on problems of teaching 
which are now too often entirely ignored. It is evident 
that the arrangement of sections in Economics A offers a 
particularly good opportunity for exact comparison of the 
results of different modes of procedure in the class room. 
Many of the policies and devices contained in the list of 
Section II of the chapter on Method might be tested by 
controlled experiment in these sections. We woxild suggest 
as especially profitable fieids for experiment in method the 
following: 

(i) The use of devices other than preparatory questions 
for arousing interest and curiosity in advance of class dis- 
cussion, reading, or the lecture on a given topic. Discussion 
in class and the assignment of reading in current newspapers 
and magazines might bring even better results than the use 
of printed questions. 

(2) The presentation in class of the materials and at 
least the beginning of the process of memorizing them imder 
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the direction of the instructor, in cases where figures, graphs, 
terms, etc, are to be leamed from visual impressions. 

(3) The use of reports from students, brief debates, 
questions and problems framed by the students, and other 
devices for securing participation by the class as a means 
of assuring complete imderstanding of a generalization, 
principle, or complex situation, with which the class should 
be made thoroughly familiar. 

(4) The use of at least one practical project or investiga- 
tion of considerable extent in the course of the year as a 
means of giving to students a fuller imderstanding of the 
nature of economic facts and principles. 

IV. Proposal for a Fundamental Test 

One of the first proposals of the Inspection was the 
formulation of a general test by which growth in ability to 
handle economic data and solve economic problems might 
be measured. It seemed to us not impossible to secure a 
set of questions, or better still, several alternative sets, 
comprehensive enough to cover most of the main fieids of 
economic inquiry and dijØ&cult enough to test the ability of 
advanced students, yet presenting problems of such common 
interest and general importance that even the beginner 
might attack them with some measure of comprehension. 
Such a set of questions could not be used, of course, as an 
ordinary examination, since the answers to them might be 
leamed in advance if it were known that they were to be 
given more than once. A test of this sort would be useful 
only as a measure of the increase of general abiUty in the 
subject resulting from any given amoimt of study of eco- 
nomics or any particular phase of it. It would be essentially 
an instrument of investigation. 

Obviously, the questions to be used in such a test would 
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have to be tried first in section meetings or examinations in 
several of the courses in order to discover their availabil- 
ity for this particxilar pnrpose. Questions which could be 
answered with complete success by a large proportion of the 
students at the end of the introductory course would not be 
suitable, nor would questions too difficult even for relatively 
advanced students. Questions to which the answers would 
necessarily be overlong and hard to grade would not do; 
for an essential requirement of the test would be that retums 
from it coxild be graded with considerable accuracy. For 
this reason, and also for the obviously necessary purpose of 
excluding problems on which economists are still too largely 
in doubt, it woxild be necessary to exclude questions which 
coxild not be carefully analyzed for the accurate grading of 
answers. These requirements make the formulation of a 
fimdamental test a time-consuming and difficult task. We 
could not delay the other phases of the Inspection in order to 
secure a large number of questions and to prove their value 
for this purpose. In consequence, only one question was 
tested by giving it in a section meeting in Economics A and 
again in the final examination. Professor Day, however, 
handed in a number of questions which he considered 
promising for use in the test, and some of these are presented 
here, together with the results of the two examinations in 
Economics A, on which the first question was set. 

The character of the questions submitted by Professor 
Day as possibly suitable for a fimdamental test may be seen 
from the f ollowing examples : 

1. To what extent and in what manner do the f ollowing contribute 
to the formation of capital: a miser; a postal savings bank; a life in- 
surance company; govemment borrowing; a manual training school 
teacher; a college professor? 

2. In what respects is the wide extension of the corporate organiza- 
tion of industry advantageons, in what respects disadvantageous, for 
(a) the business man? (i) the investor? {c) the community at large? 
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3. What part, if any, do commercial banks play in (a) the process 
of investment? (b) the increase of capital? (c) die course of industrial 
development? (d) leadership in the business world? In what respects 
may the influence of commercial banks be imdesirable? 

4. By what process, if at all, should you expect the following to 
influence the general price level in the United States: (a) advertising; 

(b) the growth of the trusts; (c) increasing demands of trade-unions; 

(d) extravagant purchases of automobiles; (e) increased output from 
South African gold mines; (/) wider use of deposit accoimts in France? 

5. Explain the parts played in the coiurse of industrial crises and 
depressions by (a) distributing middlemen; (b) finandal middlemen; 

(c) the acciunulation of fresh savings; (d) extensive crop failures; 

(e) an increasing gold supply; (/) the failure of an important indus- 
trial incorporation; (g) an extension of govemment interference with 
the conduct of business. 

6. In the case of urban sites, what are the arguments for and 
against state appropriation of (a) all economic rent? (b) all future 
increases of economic rent? (c) part of future increases of economic 
rent? 

7. Should taxation be used as an instrument for (a) appropriating 
illegitimate incomes? (b) restricting undesirable business practices? 

(c) absorbing monopoly profits? (d) redudng inequalities of wealth? 
For what other objects may taxation be employed? 

8. Give the arguments (a) from the viewpoint of the trade-imionist, 
(b) from the viewpoint of the economist, for and against 

1. the dosed shop; 8. a standard rate of wages; 

2. the open shop; 9. semi-military discipline by em- 

3. the closed union; ployers; 

4. the open union; 10. the"scab"; 

5. labor-saving appliances; 11. the strike; 

6. limitation of output; 12. the lockout. 

7. piece-work; 

9. How is industrial leadership affected by (a) the diffusion of 
education? (6) freedom of opportunity? (c) inequality of possessions? 

(d) inunaterial rewards? 

10. Upon what grounds, if any, are the following to be condemned 
or justified: (a) the right of inheritance; (b) the institution of pri- 
vate property; (c) the leisure dass? 

The question set in the regular class meeting of Economics 
A for October 18, 1913, and repeated on the final examination 
in June, 1914, was as follows: "*The principle of protection 
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is to build up our home industries by manufacturing our 
own products. This gives our people employment, keeps 
the money in the coimtry, and makes this country an inde- 
pendent and self-reliant nation.' Wherein are these argu- 
ments valid? Wherein invalid? Give your reasons." 

The answers to the question were to be graded accord- 
ing to the following analysis of the elements a correct 
answer was expected to contam. 



Analysis 

Question parts: 

1. The prindple of protec- 

tion is to build up our 
home industries by 
manufacturing our 
own products. 

2. This gives our people 

employment. 



FOR GSADING AnSWERS 

Weight 
Answer parts : given : 

I. The prindple ofprotection not .02)/^ 
necessarily confined to man- 
ufacture. May apply to 
agriculture, for example. 



•30 



3. Keeps money in 
country. 



the 



2. Protection does not increase 
employment, but simply 
changes the direction of 
industry. 

3a. This involves the falladous .20 
notion that all importations 
are paid for in money. Of 
course only international 
balances are settled in 
spede. 

6. High protection may cause a .02)^^ 
somewhat greater share of 
the world's monetary stock 
to remain in the coimtry. 

c. The statement implies that .12^ 
money is peculiarly desir- 
able or in a spedal sense 
"wealth." This, of course, 
is erroneous. A large stock 
of money is, in general, no 
gain; it simply means the 
use of a greater nmnber of 



counters. 
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d. There æay be a sLight gain, .02^ 
however, in the purchase of 
foreiga commodities pro- 
duced on & lower price 
level. 

4. And makes tiiis country 4a, Self-suffidency is no more .35 
an independent and an economic goal among 

self-reliant nation. nations tiian among indi- 

viduab. Division of laber 
is desirable, for it leads to 
the adaptation of iadustry 
to economic advantage. In 
other words, nations will 
produce those commodities 
in the production of which 
they have the greatest com- 
parative advantage. 
h. Militaiy self-suffidency may .05 
perhaps be justified on poUt- 
ical grounds. 

One hundred and twenty-two answers to this question 
on the papers written in October were carefully corrected 
according to the above analysis by the staff of Economics 
A and the grades given are compared below with the grades 
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received by the same men on this identical question in the 
final examination in Jime, 19 14. 

The table shows, as might be expected, a general shif ting 
toward the higher ranks ; but it shows also that the question 
thus tested would be fully available for such a list as was 
proposed. The question proved dijØ&cult for beginners, yet 
not too difficult, since 61 per cent of the October answers 
could be graded 10 or above. It also proved sufficiently diffi- 
cult for the majority at the end of the year, for almost half 
(57) of the men received a final grade lower than 60. In 
continuation of this experiment it would be interesting to 
give the same question to students in higher courses in the 
Department, both during the fall and at the end of the 
year. 

V. Examination Questions 

According to the statements made by the instructors of 
the Department, which for convenience of reference are 
summarized below,^ two dearly defined aims characterize 

1 Instructor 

B . . To think dearly, and form a rational condusion; development of the 
power to analyze ... to orient oneseif, and keep one's bearing in the 
midst of the varying winds of doctrine; to reason consecutively. 

F . . I. Training in assimilation of facts (to put men in possession of the 
prindpal facts). 
2. Training in critical analysis, 

G . . I. Survey of the subject at large (information). 

2. Train men in thinking and reasomng (independerU tkinking), 

3. Better dtizens. 

4. Training in investigation (advanced course). 

£ . . Perspective and background through information (historical course), 

and in addition, questions which develop power of réUUing information* 
D . . Analjrsis of materials, methods of presentation; acquaintances with 

courses. 

To weigh carefully; reason cogently; more capadty for comprehension 

and analysis. 

To teach students to analyze. 
C . . ''To cultivate by practice the analytical faculty and judgment." 

To consider ''analytically a faet so as to find out its dements or its 
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practically every course in the Economics Department: 
(i) the imparting of a certain amonnt or sort of information; 
(2) training in the ability to analyze, to relate facts, and to 
reason. By some it is implied that this is a general training, 
but for the most part it is specified that the training is in 
handling the particular body of facts presented in the course. 

In addition, a third aim is assigned in some of the advanced 
courses, — namely, training and guidance in independent 
thinkmg and investigation. There are one or two other 
aims stated, as for example, that of preparation for citizen- 
ship. 

The examination questions given in these courses ofiFer 
one way of estimating in how far their aims are actually 
realized. If it is intended to train students in reasoning, 
for example, the examination questions should be tests of 
their abiUty to reason. They should demand not simply a 
memory of how others have reasoned about these situations, 
but actual independent reasoning and thinking. With this 
question in mind, the examination papers in the various 
courses were inspected to determine what proportion of 
the questions in the examination papers call for information, 
and what proportion demand specifically analysis and 
reasoning. 

The questions have been divided roughly into two 
classes, — "memory" questions and "reasoning" questions. 

significance, and the relation of the discovered faet to other facts 
either obvious or derived." 

''Memoiy plajrs ahnost no part in the work. Only analjrsis and judg- 
ment will accomplish anything." 
To cultivate the power to analyze a business situation. 
A . . General knowledge of prindples and their applications, and the real 
meanings of the study. 

As much knowledge as possible of prindples and the application and to 
Train students in methods of investigation and reasoning ... to get 
men to think for themselves. 
Acquaintance with literature. 
"To impart information, to teadi men to think and to investigate." 
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"Memory" questions were considered to be those that 
involved merely a statement of faet or opinion evidently 
developed in lectures, required reading, or sections. "Rea- 
soning" questions involved expressions of opinion on the 
part of the student, organization of data in the examination 
room, analysis of new situations, and relating information 
to economic theory. 

Some of the questions classified imder "reasoning" doubt- 
less demand simply memory of reasoning done in class or by 
the instructor, and probably others demand merely the 
memory of a formula, the rest being the somewhat mechani- 
cal application of it; but it would not be possible to decide 
in these cases without a very intimate knowledge of the 
courses in question. On this accoimt there is doubtless more 
"memory" work demanded on the examinations than the 
results reported below would indicate. 

Ten examples of questions which were considered to call 
primarily for memory and ten which were considered to call 
for reasoning are listed below.^ 

* "Memory" Questions 

1. "The standard of living affects wages not directly, but" — how? 

What evidence of varying standards of living appears in the statistics of births 
and deaths for different countries? for different social classes? 

2. Under what conditions does inconvertible paper money drculate as readily 
as specie? Under what conditions, not as readily? 

Under what conditions is the value of inconvertible paper money as great as 
that of spede? Under what conditions is its value less than that of specie? 

State two indications of its having less value than specie. Which of the two 
is the more significant? Which is the more easily ascertained? 

3. State points of similarity, points of difference, between the Federal Reserve 
system and the English banking sjrstem as regards (a) centralization of reserves; 
(b) centralization of note issue; (c) measures available for preventing panics. 

4. (a) How was the capital for the construction of railroads prior to 1870 
obtained in the different European countries? Why? 

{b) Why was the railroad policy of Prussia modified after 1870? With what 
results? 

5. Compare the English and Belgian methods of relieving the recent agricul- 
tural depression. 
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Fifty-one examinations, both mid-year and final, set in 
the following courses dnring the years 1912-1913, 1913- 

6. Give an account of the main developments in the London money-market 
from the outbreak of the War until the end of February, 1915. 

7. Ezplain: "puts''; "borrowing and carrying"; stock-exchange dearing 
house. Discuss the relations of the Stock Exchange and the banks in New York. 

8. Compare the views of Mill and Ross as to the limits of social control. 

9. What, according to Ross, is the relation of resentment to social worker? 
zo. What is sabotage? 

"Reasoning" Questions 

1. Construct a simple index number of prices for 1914, using 1908 as the base. 
(A) Would the index-number point to a rise or a fall in the value oi money? (B) 
Would a Board of Arbitration be justified in recommending a change in wages? 
If so, on what basis? If not, why not? 

2. Explain briefly the immediate and the ultimate effects (if any) which each 
of the following changes, taken separately, will tend to have on the price of cotton, 
cotton-seed oil, and cotton-mill machineiy; (a) prohibition of organized specula- 
tion; (6) a change of fashion toward greater use of cotton fabrics; (c) doubling 
of the population of the country. (Assume for all three cases that there is no 
international tråde, and that the quantity of money remains the same.) 

3. In what direction and by what process, if at all, would the following tend 
to affect the value of money in the United States: (a) increased demand for gold 
ornaments; (6) increasing lavish expenditiures by spendthrifts; (c) a continued 
drain of specie to the East; (d) a larger output of silver in the United States; 
(e) abolition of all legally required banking reserves? 

4. Outline briefly your views as to the immediate influence of the Civil War 
on (a) land policy, (6) banking, (c) tariff, and (d) industrial progress North and 
South. 

5. "Surpluses have spelled disaster to the United States." Do you agree? 
When and how? 

6. Assuming the laws of the United States to remain unchanged, how would 

our monetary stock be affected if the market ratio of gold and silver should be- 
come 18 to i; 15 to i; 12 to i? 

7. In Austria, "af ter 1870, — the value of paper money with respect to silver 
steadily rose until, in 1878, it reached parity with silver ... In 1879, the free 
or private coinage of silver was stopped." Consider whether, after this action, 
the (i) silver pieces, and (2) the paper notes were commodity, credit, or flat 
money? Had Austria not closed the mints to the free coinage of silver, how would 
the following have been affected in that country: (a) the monetary stock; {b) the 
monetary standard; (c) the value of money? 

8. Explain or illustrate exactly what you understand by self-interest. 

9. Outline a program for raising the wages of all the lower grades of labor. 

10. Would the following appear on the income sheet or on the balance sheet? 
Under what name in either case? 
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1914, and 1914-1915, were included in the study: A, i, la, 
2a, 2b, 3, 4a, 4b, s, 6a, 7, 8, 9, II, 12, 13, 14, 24, 31, 32, 33. 
The results were as f ollows (in percentages) : 

"Reasonmg" Questions 
88 
83 
62 

93 
38 

32 
33 
37 
33 

20 
26 

45 

75 

13 
o 

100 

47 
22 

40 

The above table gives the proportions in the final examina- 
tions only. Certain mid-year papers were also examined 
as f ollows (in percentages) : 

Total of Mid-Year 
Memoiy Reasoning and Final 

Questions Questions Memoiy Reasoning 

Instfuctor G . . . . 46 54 48 52 

Instructor D , . . , 55 45 46 54 

Insiructor A , , . . 17 84 31 69 

Concltision: There are discrepancies here and there 
between the statement of the aims of the instructors and 

{a) Cost of a patent bought. 

(6) Rent for storage of new machinery ordered from different firms and de- 

livered at different times, but to be installed together, as soon as all arrives, 

in a new shop. 
(c) Author's rojralty on a copyrighted stoiy printed and distributed in an ez- 

tended advertising campaign. 
(^ Cost of heating during permanent interior decoration of a new store. 
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the evidence fumished in the examination questions. The 
latter, of course, do not provide an altogether sufl&cient 
criterion on which to judge, but it is to be noted that, in the 
main, there is agreement between the statement of aims 
of the instructors and the kind of questions set in the 
examination papers. This is notably so in the case of 
Instructor C. 



CHAPTER V 

THE QXJESTIONNAIRES 

I. CONSTRUCTION OF THE QUESTIONNAIRES 

DuRiNG the fall of 1914 provisional questionnaires to 
graduatesand to students weredrawn up and submitted to the 
Department of Economics. A joint committee later put these 
questionnaires into final f orm, and they were sent to alumni 
in February 191 5 and given out in classes early in March. 

The questionnaires read as follows, the larger printed form 
allowing ample room for replies: 

I. Qtiestionnaire to graduates 

Hasvabd University 

Ditdsian of Educatian — Departmeni of Economics 

Dear Sir: 

The Department of Economics has invited the Division of Educa- 
tion to investigate the midergraduate instruction in Economics with 
a view to its improvement. This set of questions is sent out by the 
Division of Education with the approval of the Department of Eco- 
nomics. The Department of Economics joins the Division of Educa- 
tion in requesting that you give the questions your careful attention 
and mail this sheet in the enclosed envelope by March — . Your 
answers will be received by the Division of Education and wiU be 
treated as confidential by that Division if you so desire. 

Yours truly, 

The Department of Economics, 
The Division of Education. 

1. Name. Class 

2. Address. 

3. Occupation. 

107 
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4. On the following page, please list the courses in Economics 
you took at Harvard and make some statement concerhing 
their subsequent value to you. Have the comses proved 
valuable (a) in your vocation, and if so, in what way? 
(b) in your sodal, civic, or economic activities outside your 
vocation, and if so, in what way? (c) in other, more general 
phases of your life, and if so, in what way? Please fed free 
to make your statement in your own terms; if you cannot 
specify as to courses, but can make a general statement con- 
ceming your work in Economics as a whole, please do so. 

Courses Year Statements 



5. Can you ascribe any of these values to a particular part or re- 

quirement of a course — as, for example, to a certain book 
assigned, lectures on a particular topic, a particular method 
of presentation or of study, or a particular thesis requirement? 

6. In what way would a dififerent treatment of any of these courses, 

either as to subject matter or as to method, have made it 
more valuable to you? 

7. Is there any aspect or field of Economics which you now wish 

you had studied in college? Plej^gi^^dicate, in particular, 
such subjects as you desired to study in college but did not 
find offered in the programme of the Department. 

8. What suggestions or critidsms, general or spedfic, have you to 

oflfer? 

2. Questionnaire to sttulents 

Hasvasd University 

Division of Ediicaiion — Department of Economics 

The information called for below is desired in order that the courses 
in the Department of Economics may as far as possible meet theneeds 
of the students. You are requested to give the data called for as fully 
as you are able. Your answers will be received by the Division of 
Education, and will be treated as confidential by that Division. The 
answers \dll not be shown to instructors in Economics without the 
permission of the writers. 
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Please mail this sheet in the accompanying envdope not later than 
March 00. 

1. Name. 

2. Address. 

3. Candidate for what degree? 

4. Class? Underline: 1915, 1916, 1917, 1918. 
Graduate School of Arts and Sciences? Year. 
Graduate School of Business Administration? Year. 

5. Indicate the courses you have completed in the Department 

of Economics: 



Course 


Year 


Grade 


Course 


Year 


Grade 




• • • • 

• • • • 






• • • • 

• • • • 













6. What courses are you now taking in Economics? Do you in- 

tend to take others? 

7. What is your field of concentration? 

8. In what field, if any, are you a candidate for the A.B. with 

distinction? 

9. What is to be your vocation after graduation? 

Do you expect your study of Economics to help you in that 
vocation? How? 

10. What are your general reasons for studying Economics? 
What were your spedfic reasons for choosing particular courses? 
On what information and advice, if any, did you select your 

courses in Economics? 

11. What courses in the University, outside the Department of 

Economics, have you found most helpful in your study of 
Economics? Why? 

12. What difficulties have you met in your study of Economics? 
Please reply frankly and specifically, indicating any lack of 

facilities, disadvantageous arrangement of requirements in 
reading or thesis writing, lack of supervision in your work, 
or other obstacle to progress. 
If you have found any coiurse disappointing, please name 
it and tell why, in your opinion, it did not meet your 
needs. 

13. Mark in order (i, 2, etc.) the following phases of the work 

according to their relative helpfulness to you, beginning 
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with the most helpful: lectures; dass discussions; assigned 
reading; reports; essay writing; laboratory exercises; com- 
ments or additional information. 

14. Do you find your instruction in Economics related to the 

problems you meet in life? How? 
Are you interested in any particular movement or problem of 
the day? What? 

15. What added suggestions or critidsms, general or spedfic, have 

you to ofifer? 

The replies were satisfactory in number and almost 
without exception careful and serious in character. Since 
the value of any answer, criticism, or suggestion made in 
responsa to a questionnaire depends very largely on the 
eamestness, standing, and character of the one who responds, 
it seemed best not to try on most of the points to secure data 
which could be håndled statistically. Coimtrng votes is 
not an especially profitable way in which to secure guidance 
in dealing with a technical problem. The drift of opinion, 
however, was in this case, as it is in others, worth knowing, 
and the simunaries given below show the drift of opinion on 
a number of important matters. Yet if any suggestion or 
criticism is to be assessed at its proper value, the records of 
the men who make it must be known; and for this purpose 
(since it was obviously necessary to promise that the replies 
themselves should be received in confidence) the data from 
all the replies were entered on large sheets so that anyone 
interested might f ollow any reply across the various columns, 
get its general tenor, discover the courses taken and grades 
eamed by the individual thus responding, and such other 
pertinent facts as his vocational purpose, or his reasons for 
taking courses in Economics. 

The critidsms and suggestions from alunmi conceming 
particular courses were recorded on a special set of cards and 
specific mention of individual instructors on a separate 
sheet. These special data and the large sheets mentioned 
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above are in the hånds o£ the Department of Economics.^ 
This chapter deals solely with questions of some general 
importance. 

II. The Returns 

A. Replies from Alumni 

1. The number of replies received was 330, out of a possible 
thousand — a proportion reasonably gratifying in view of 
the somewhat formidable character of the questionnaire, 
and a total qnite suflScient for safety in drawing conclusions. 
Twelve of the replies were not included in making the sum- 
maries which f ollow, either because the writers had taken no 
courses in Economics or because their answers were not 
pertinent. The summaries are based, therefore, on 318 
replies. 

2. The classes in which the men were grouped ranged 
from 1880 to 1913, as follows: 

Claas Number of Men Class Number of Men 
1880 I 1904 4 

1890 3 1905 26 

1891 42 1906 24 

1893 I 1907 16 

1894 12 1908 2 

1896 II 1909 18 

1897 X 1910 9 

1899 9 X911 21 

1900 I 1912 25 

1901 12 I913 20 

1903 60 — 

Total 318 

3. The standing in the community of some of the writers 
was suggested by the faet that their names were f oimd in 

1 In order to secure data on spedfic courses now (1916-17) actually in opera- 
tion, the Department of Economics has issued a second questionnaire to imder- 
graduates, framed in light of our experience with the questionnaires here discussed. 
The returns from this second list of questions are available, and so far as they are 
of general interest may be secured from the Department. 
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"Who's Who in America" for 1914-15. Seventeen of the 
318 writers were included in the records of this publication. 

4. The degrees received by the writers are shown in the 
following list: 

Baccalaureaie Degrees 

A.B 308 

A.B. without distinction 158 

A.B. cum laude 87 

A.B. magna cum laude 52 

A.B. summa cum laude ix 150 

S.B 10 

Higher Degrees 

A.M. . . ' S6 

Ph.D '. . 21 

L.H.D I 

M.D IS 

LL.B 71 

M.E I 

M.E.E 2 

S.T.B 6 

S.T.D I 

M.F 3 

M.BA 2 

Mus.B I 

The group as a whole is therefore highly respectable, 
academically speaking. 

5. The occupations of the writers are shown in the follow- 
ing table. There is a slight overlapping due to the faet that 
a f ew men gave more than one occupation. 

Older Professions 

Thelaw 74 

Teaching 46 

Medierne 15 

The ministiy 7 

142 
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Technological Professions 

Engineering 11 

Naval engineering i 

Mining geology i 

Forestry i 

Chemistry 3 

Architecture S 

22 
Business 

Manufacturing 18 

Management ; . . . 9 

Fidudary positions 12 

Banking and brokerage 22 

Real estate and insurance 8 

General commerce 13 

Advertising 3 

Publishing 4 

Transportation 3 

Bookkeeping 3 

Buying, selling 6 

Unclassified i 

102 
Agricrdture, etc. 

Farming 8 

Horticulture i 

9 
Journalism 

Newspaper or magazine work 8 

Other Occupations 

Art 2 

Study 16 

Secretarial work 6 

Statistics 3 

Public service S 

Scientic work ; 3 

Not given 7 

6. The courses in Economics taken by the writers appear 
in the following list: 
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Economics I (now A) only 82 

Economics I and other courses 232 

Other courses only 4 

Middle-group courses 175 

Ui^r-gioup courses 21 

Undassified 38 

7. The values assigned to instxuction in Economics are: 

(a) VocaUonal values found by 135 men 

(b) Social and civic values found by 84 " 

(c) General values found by 205 ** 

The retnms on this point are considered in greater detail 
below. 

8. The parts of the work which the men mentioned favor- 
ably or unf avorably were : 

(a) LectureSf of which 31 men speak favorably 

although 9 men speak imf avorably 

(b) Section meelings, of which 20 men speak favorably 

although 20 men speak imf avorably 
{c) Theses, of which 33 men speak favorably 

although 4 men speak imfavorably 

9. The methods singled out for special mention by more 
than one man were: 

(a) The method employed by Professor Taussig in Economics 2 

This method is variously referred to as the Socratic, the quiz, and the 
dass discussicm method. It is spedfically and favorably mentioned by 
II men. 

(6) The method employed by Professor Carver in Economics 3. 

This method is referred to as the discussion method and is favorably 
mentioned by 6 men, although i other did not find it inspiring. 

Case and class discussion methods are mentioned favor- 
ably, but not in connection with any particular coiu-se, by 
10 men. One man, however, considers the case method 
imsuited to imdergraduates. Sixteen men speak favorably, 
in a general way, of quizzes or of other ways in which 
participation by students in class work may be secured. 
Many insist on small classes and personal contact with the 
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professor. Four lay stress on the great advantage of thesis 
work. Of two others who speak favorably of theses, one 
thinks they should be required often and short; whereas 
the other would require only f ew theses, on the groiind that 
their preparation demands much time and attention. One 
man would require a thesis in Economics A. Three speak 
favorably of the written tests and papers. 

10. The assistants are mentioned as follows: 

Favorably by 7 men 

Unfavoiably by 31 " 

Other replies which cover section meetings and the work 
of assistants together are smnmarized more completely 
below. 

11. The courses men wish they had taken were: 

1. Accounting domen 

2. Banking 19 " 

3. Sodology 12 " 

4. Business Administration 12 " 

5. Transportation 10 " 

6. Labor Problems 8 " 

7. Foreign Exchange 6 " 

8. Commercial Law 5 " 

9. Eænomics of Agriculture 3 '* 

10. Foreign Tråde 3 " 

11. Financial Crises 3 '* 

12. Tariff 2 « 

13. Statistics 2 ** 

12. Suggestions and criticisms were offer ed by a large 
proportion of the writers, and may be simmiarized in part as 
follows : 

a. Lack of practical application was mentioned so many 
times that it must be listed as a major criticism. 

In all, this criticism is made or directly implied by 63 men 

The opposite view was held by . i man 

Further analysis of the suggestions under this head is 
made in a later part of this Section. 
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Specific suggestions were: 

1. More frequent reference to current events suggested by ... . 30 men 

2. Closer study of labor unions suggested by 6 ** 

3. Fuller training in elementary bookkeeping as a preparation for 

the course in Accounting suggested by 5 '' 

4. The study of modem sodological problems suggested by . . . 2 ** 

5. Visits to Boston banks suggested by 2 ** 

6. Lectures by successful business men on their q>ecialties .... 2 " 

7. Admission of undergraduates to courses in the Business School 
suggested by 2 " 

8. The study of stock exchange methods suggested by i man 

9. Investigation of actual business methods suggested by ... . i " 
10. The study of investments suggested by i '' 

b. Miscellaneous suggestions and comments may be listed 
as follows : 

1. Greater opportunity for contact with professors suggested by . 6 men 

2. More general courses in Economics at the expense of ^>ecialized 
courses suggested by 5 " 

3. The treatment of economic theories as less fixed than has hereto- 

fore been the custom stiggested by 4 '' 

4. Diminution of memory work in favor of development of thought 
suggested by 4 " 

5. Fuller guidance in the selection of courses suggested by ... . $ *' 

6. Making some study of Economics compulsory stiggested by . . 3 '' 

7. Provision for direct practical training for definite work suggested 

by 2 " 

8. The teaching of methods rather than facts suggested by ... . 2 ** 

9. Vocational guidance in college suggested by 2 " 

10. Requirement of more written work suggested by 2 ** 

11. More coUateral reading suggested by 2 " 

12. More careful selection of reading and better correlation with the 
lectures suggested by 2 " 

13. Closer correlation of section meetings and lectures suggested by i man 

Strong commendation of conrses in Economics and the 
methods of instruction in vogue in the Department is not 
infrequent, and most of the answers imply satisfaction with 
the instruction in one way or anotiier. Eight men speak in 
especially high terms of the courses given during their time. 

13. On the values assigned to the instruction, to section- 
meetings and assistants, and to the practical applications of 
the instruction, more elaborate analyses were made. 
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The Value of Economics Cour ses to Lawyers and Judges 

Of this group 18 took Economics i only, 12 took two 
courses, and 42 took three or more courses. Nineteen were 
graduated before 1900, 36 between 1899 and 1908, and 27 
from 1908 to 1 9 13, inclusive. 

Value in Vocation 

Number Per Cent 

Number of replies considered 72 — 

Decidedly advantageous in vocation . . 7 10 
Favorable comment, moderate or uncer- 

tain statements 21 29 

Vigorous adverse comment 2 3 

Adverse, less vigorous comment .... 3 4 

Totals: Advantageous 28 39 

Of slight value if any .... 5 7 

No comment 39 54 

Social ar Civic Value 

Number Per Cent 

Niunber of repUes considered 72 — 

Decidedly helpful in these respects. . . 6 8 
Favorable comment, moderate or uncer- 

tain statements 13 18 

Vigorous adverse comment 3 4 

Adverse, less vigorous comment .... 2 3 

Totals: Courses helpful 19 26 

Of slight value if any .... 5 7 

No comment 48 67 

General CuUural Values 

Number Per Cent 

Nimiber of replies considered 72 — 

Decidedly helpful in these respects. . . 9 13 
Favorable comment, moderate or imcer- 

tain statements 41 57 

Adverse comment i z 

Totals: Favorable comment .... 50 70 

Adverse comment x z 

No comment 21 29 
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Various Valnes Mentioned in Different Replies 

A considerable number stated directly or implied by their 
answers that it was difl&cult to name specific values which 
had resulted from the courses taken. They felt that they 
had been helped m various ways but were xmable to discover 
tangible results or give concrete examples. Fourteen (20 
per cent) made dei&nite statements to this efiFect. 

Eighteen (25 per cent) thought that they had been helped 
in f orming their opinions on current questions aside from 
political issues. Nine (13 per cent) were better able to 
decide political questions. 

Mental discipline or general training of the mind is evi- 
dently considered an important result by many of this 
group. Eleven (16 per cent) make explicit mention of this 
point. 

Eight (11 per cent) had formed habits of logicai thought 
and careful investigation which were of assistance in their 
law practice. The method of Economics 2 was often 
alluded to as being especially valuable in this particular. 
Accoimting was regarded by 7 (10 per cent) as being a 
subject which had proved of practical value in keeping their 
own accounts and m understanding the cases with which 
they dealt. Three (4 per cent) regarded the study of 
banking as having similar values. One spoke of the course 
in transportation as having been of practical assistance. 
Four (6 per cent) had a better imderstanding of busi- 
ness and corporate matters by reason of having taken 
Economics courses. 

Nine (13 per cent) regarded the courses taken as being 
a valuable introduction to the field of economics, and 7 
(10 per cent) were stimulated to do further private reading 
and study. Four (7 per cent) spoke of the courses as 
having "cxiltural" value. Three (4 per cent) mentioned 
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being better able to iinderstand matters about which they 
read in newspapers or magazines. Three (4 per cent) had 
been stimulated to think more thoroughly on all subjects. 
Three others were able to converse more intelligently on 
economic subjects. Two felt that they were better able to 
grasp the work of the law school. One regarded the subject 
matter as "valueless" but had received some benefit in 
other ways. 

Quotations from Lawyers on Values of Courses in Vocation 

The degree granted from Harvard or other universities is 
noted in each case. If some special office is held, mention is 
made of the faet. Numbers ref er to courses taken. 

No. 16. A.B. (magna cum laude) LL.B. A.M. Class of 
1 89 1. Economics i and two others. Judge of Juvenile 
Court. 

I cannot say that any of these courses have been of direct 
vdue to me in my vocation or in my social, dvic, or economic 
activities, but I consider all my work under Professor Taussig 
of great value to me in making up my mind as a voter on eco- 
nomic issues, and in my general understanding of the social 
order and the essence of wealth, the real fimction and nature of 
money, and the relation between capital and labor. 

No. 56. A.B. A.M. Class of 1891. Economics i and 2. 
Department of Agriculture, Washington, D. C. 

The chief benefit I got, especially from the study of economic 
theories, was the mental disciphne. I also received some in- 
delible impressions which have ever since affected my point of 
view and method of approaching economic and public ques- 
tions. . . . Except for the past two years, I have engaged con- 
tinuously since 1894 in the general practice of law. It is only 
fair to say that one engaged in such an occupation is apt, at 
some time, to find use for every type of infomiation; this is as 
true of one who devotes himself largdy to giving advice to 
dients as of one who partidpates much in the trial of litigated 
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cases. . . . My contact with Mr. Brooks and my studies 
under him have, I feel sure, given me a much more sympathetic 
attitude toward social questions, such as general unrest, labor 
unions, and cooperation, than I would have had otherwise. . . . 
I can still hear Mr. Taussig talking and promoting controversy 
and discussion. I am sure that I was aided in my power of 
analysis, in the development of my capadty to weigh evidence 
and to balance off arguments, and in the growth not only of 
willingness to do, but of unwillingness not to do my own think- 
ing. I prepared a thesis or special report for Mr. Brooks on the 
Farmers' Alliance Movement which was helpful to me in de- 
vising methods of getting data and in arriving at an understand- 
ing of a particular problem. 

No. 228. A.B. (cum laude) Class of 1891. Economics i, 6, 
and 2 (half year). 

In trying land damage cases in court, I find that the subject 
of real estate values and rents is illuminated by what I leamed 
in this course. (Economics i). Business and affairs are the 
practical matters with which the activities of most of us are con- 
cemed; the courses in politicai economy lie doser to our later 
work than any other courses excepting possibly the English 
composition courses. The general discussions in dass led by 
Professor Taussig were most interesting and hdpful. They 
were more valuable than thesis writing. The latter is chiefly 
research work which has no permanent vdue different from the 
research work done in history or other courses. 

No. 22g. LL.B. Class of 1912. Economics i, 3, 18, 4, and 
2B. Social Ethics i. 

The real value from a course comes from the ability of the 
instructor to interest the student enough to do more than the 
required work and to continue study of it after college. Both 
Professors Garver and Gay sent me away feeling that I had 
been introduced to a subject worthy of f urther development; 
Professor Cole's course completed the training for one who does 
not become an expert accountant and has been of great value 
in severd ways, espedally in that the language of the business 
world is not Greek to a college man. The course in sodology 
was very instructive and of great value to a lawyer. 
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No. dy. A.B. LL.B. Class of 1906. Economics i, 6, 8a, 
8b, 18, and 21. 

Of these coiirses, by far the most useful since graduation was 
Mr. Cole's course on Accounting. I caimot speak too highly of 
it. Professor Sprague's Economics 6, Financial History of the 
United States, and Economics Sa and 86, Money and Banking, 
were interesting and instructive, but I have not foimd the in- 
formation gained in them of any real value in the practice of 
law. Economics 21, on Business Law, I have always regarded 
as time wasted. 

No. 106. A.B. (cxim laude) LL.B. Class of 1907. Eco- 
nomics I, 6, 8a, 8b, 12b, 23^ 23^, 12a. Treasurer. 

Except for Economics 21, I do hot value the courses on the 
basis of subject matter. In all of Mr. Carver's courses the 
greatest value was foimd in watching his mind work. Every de- 
velopment was so absolutely mathematically correct. ... All 
courses in college were to my mind developers and the acquisi- 
tion of miscellaneous information a mere chance which might as 
well occur in general reading as in a course. ... I desire to 
raise a query as to the concrete bénefits of courses on special 
subjects. For instance, the course on corporations is imdoubt- 
edly a wonderful course, but outside of the men who went to law 
school and leamed it all over not one in fif ty can state a single 
faet in the laws of corporations in restraint of tråde. It did 
however grease a lot of heads which had done no previous think- 
ing. The title caught the subjects but the course produced the 
results and the Sherman Aet did not. 

No. 270. A.B. (magna cum laude) LL.B. Class of 1909. 
Economics i and 2. 

These two courses taken together constitute a general incur- 
sion into the subject and fumish a good working knowledge of 
economics which I believe to be a necessary part of a lawyer's 
equipment. These courses . . . have fumished a basis upon 
which I can rely in acquiring such special knowledge in a par- 
ticular part of tbe subject as may from time to time be needed; 
for example, foreign exchange during the last simmier, or anti- 
trust matters in relation to the Sherman and Clayton Acts. 
Economics 2, in its conference method of presentation, is a 
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most excellent mental training. I found it very helpful in pre- 
paring the way for a similar presentation of law in the law 
school. 

No. lyg. LL.B. Class of 1907. Economics i, 4, 5, 9b, 6a, 
6b, 8a, 8b, 11, 7a, 7b, 18, and 21. Deputy Attomey 
General (State). 

The conrses have been of undoubted value to me in my law 
practice, both in general practice and while representing the 
State. They gave me an understanding of the methods of 
business and general prindples on which business should be 
carried on. They gave me a training in method of study, valu- 
able in law school and in practice, espedally in how to evolve 
general rules from concrete facts. In general practice, aside 
from technical practice rules (e. g. Evidence, Code Pleading), 
in giving advice, espedally in Corporation matters, I found that 
the knowledge acquired gave me a dedded advantage over other 
men of my age who had not studied much economics. As part 
of a liberal education, they have been of value to me in my 
political activities, and sodally, by enabling me to comprehend 
and discuss intelligently questions of govemment and other 
questions of general interest. 

No. 177. A.B. (magna cum laude) A.M. LL.B. Class of 
1901. Economics i. 

Of no perceptible value in my vocation. Certainly an addi- 
tion to general knowledge in imderstanding the meaning of 
terms, names of theories, and exponents of theories. In dvic 
activities (such as City Club of New York, Department of 
Public Charities, etc), a lawyer naturally contributes the 
spedal professional knowledge he has which others may not 
bring, and in such specialty I cannot see that theoretical eco- 
nomics pla3rs any valuable part. Of coiu:se an aid in pleasant 
intercourse with fellow-men, like any other bit of knowledge; 
nothing more, discemibly. 

No. 71. A.B. (cum laude) LL.B. Class of 1909. Eco- 
nomics I, s, 9b, 2, 6b. 

I think that the courses on the general subject are essential 
to a well rounded education. They are of real cultural value. 
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I have f ound none of the cotirses valuable in my profession ex- 
cept in the very broadest sense. There is a course in Account- 
ing which I believe is listed in the Department of Economics 
which I regret not having taken. This is a coiirse which I 
think numbers of my profession will agree is of great practical 
value to them. 



The Value of Economics Cour ses to Manufakturers 

Of this group 7 took Economics i only, 2 took only two 
coiirses in the Department, and 9 took three or more courses. 
Five were graduated before 1900, 2 between 1899 and 1908, 
and 2 from 1908 to 1913, indusive. 

Value in Vocation 

Number Per Cent 

Number of replies consideied 18 — 

Deddedly advantageous in vocation . . 3 27 
Favorable comment, moderate or uncer- 

tain statements 7 39 

Unf avorable æmment o o 

Totals: Advantageous zo 56 

Of sligfat value if any .... o o 

No comment 8 44 

Social or Civic Value 

Number Per Cent 

Number of replies considered 18 — 

Favorable comment, moderate or xmcer- 

tain statements 3 17 

No comment made 15 83 

General Culture Values 

Number Per Cent 

Number of replies considered 18 — 

Deddedly helpful in these req)ects. . . 3 17 
Favorable comment, moderate or xmcer- 

tain statements 9 50 

Totals: Favorable 12 67 

No comment made 6 33 

The answers from this group were very brief as a mie and 
it seems likely that the questionnaire did not receive as much 
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attention from the manufacturers as it did from the lawyers. 
For this reason it appears probable that the same weight 
should not be given to the tabxilation of replies as would 
otherwise be expected. 

Four (22 per cent) make no comment on the benefits de- 
rived from their courses in Economics. Four mention that 
they have f ound the information of value in business afifairs. 
Four were helped in deciding political issues or questions of 
public economic policy. Three (17 per cent) foimd the 
courses a stimulation to thought on economic subjects and 
three others felt that the principles laid down had formed 
the basis of their later thought. Two (11 per cent) speak 
of the coiurse as having been valuable mental disdpline. 
Two more regard their coiurses as a general introduction 
to the field of economic reading and thought. One man 
speaks of being sufficiently interested to do f lurther reading, 
and another was helped in the comprehension of the terms 
used in tråde journals and in conversation with business 
men. One believes that the specific facts were of no 
value to him, although he derived other benefits from the 
courses. 

It is significant that none of the manufacturers mention 
the course in Banking as having been of practical value, 
although three took the coiurse. Of five who took Ac- 
counting, two mention it as having proved valuable. 
One speaks in high terms of the coiurses on railroads and 
two of commercial law. 

Quotations from Manufacturers on the Value of Economic 

Courses 

No. 148. A.B. (magna cum laude) Class of 1912. Eco- 
nomics I, 2, 6a, 6b, 7, 18, and 9. 

The prindples with which I became acquainted in the various 
courses in Economics which I took in college have formed so 
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fundamental a part of my general line of thought that they have 
undoubtedly greatly influenced me in business and been of 
value to me in every aspect of my life. . . . The work of Eco- 
nomics 18 and that of the courses in Business Law have been of 
concrete service in every business matter with which I have had 
to do. 

No. 187. A.B. Class of 1903. Economics i. 

The course has not been of value in my vocation. It has in- 
creased my interest in and understanding of dvic questions 
through belief in the need of sociological-economic reforms. It 
has not been valuable in more general ways. 

No. 2g3. A.B. (cum laude) A.M. Class of 1903. Eco- 
nomics ly Sa^ and 8b. 

I consider that the courses in economics have been of real 
substantial value; in particular in giving a better understanding 
of the broad questions related to them which come up both in 
business life and as questions of public economic policy. I do 
not consider the spedfic facts as of particular value, but fed that 
the understanding which they give of the deep imderlying prin- 
dples, however imperfect it may be, gives a real basis for better 
judgment and foresight on the private questions of one's own 
business policy as well as public matters. 

The Value of Economics Cour ses to Physicians and Surgeons 

Of this group 6 took Economics i only, 6 took two coiurses, 
and 3 took three or more conrses. Eight were graduated 
before 1900, and the remaining 7 between 1899 and 1908. 

Value in Vocation 

Number Per Cent 

Number of replies considered 15 — 

Favorable comment, moderate or uncer- 

tain statements z 7 

Deddedly adverse comment i 7 

Adverse, less vigorous comment .... i 7 

Totals: Favorable comment i 7 

Of sligfat value if any .... 2 13 

No comment made la 80 
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Social ar Citic Values 

Number Per Cent 

Number of replies consideied 15 — 

Deddedly helpful in these req)ects. . . a 13 

Favorable comment, moderate or uncer- 

tain statements 5 33 

Totals: Favorable comment 7 47 

No comment made 8 53 

General CuUure Values 

Number Per Cent 

Number of replies considered 15 — 

Deddedly helpful in these re^>ects. . . 3 ao 

Favorable comment, moderate or uncer- 

tain statements 8 53 

Totals: Favorable comment zi 73 

No comment made 4 37 

Eight (53 per cent) speak of the courses as valuable in 
"broadening one^s education," as a "contribution to general 
culture," or as giving "general training and knowledge." 
Five (33 per cent) were helped to a better xmderstanding of 
social questions and s others were better able to form 
an opinion on politicai issues. Three (20 per cent) had 
a clearer insight into financial operations, which they 
considered of value. Two had foxmd the courses in 
Banking helpful. One had been helped in his general 
reading, another in ordinary conversation, and a third 
considered the courses a part of a valuable f oxmdation for 
his later studies. 

QuoUUions from Physicians 

No. 3og. A.B. M.D. Class of 1896. Economics i and 7. 
Hospital Superintendent. 

These courses have been of value in helping me selve some of 
my medical problems, as quite a portion of my work has been 
in connection with the poor or working people. Espedally is 
this true of Economics i. 



QUESTIONNAIRES 



127 



No. 72. A.B. (cum laude) M.D. Class of 1899. Eco- 
nomics i and 6. 

Economics 6 gave me a knowledge without which I could not 
have properly understood many of the contemporary govem- 
mentsd problems. The thesis I wrote on the Merchant Marine 
has been of value in late years in coaching school debates and 
in friendly arguments since the war broke out. All in all, I 
consider it one of my most valuable coiurses. 

The Value of Economics Courses to Editors j Journalists ^ 

and Newspaper Men 

Of this group 3 took Economics i only, 2 took two or 
more coiirses, and s took three or more courses. Three were 
graduated before 1900, 3 between 1899 and 1908, and 4 
between 1908 and 1913, indnsive. 

Value in Vocaiian 

Number Per Cent 

Number of replies ænsidered lo — 

Deddedly advantageous in vocation . . 3 30 
Favorable comment, moderate or uncer- 

tain statements 4 40 

Deddedly adverse comment 3 30 

Adverse, less vigorous comment .... 2 30 

Totals: Favorable comment 6 60 

Slight value if any 4 40 

Social or Civic Values 

Number Per Cent 

Nmnber of replies considered 10 — 

Deddedly helpful In these re^)ects. . . i 10 

Favorable comment, moderate or micer- 

tain statements .... ^ ... . 3 30 

Totals: Favorable 4 40 

No comment made 6 60 

General CuUure Values 

Number Per Cent 

Number of replies considered zo — 

Deddedly helpful in these respects. . . z zo 

Favorable comment, moderate or uncer- 

tain statements 5 50 

Totals: Favorable comment 6 60 

No comment made 4 40 
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Three regard their courses as having "cultiiral" value and 
3 praise "mental training" and "methods o£ study." Two 
were given a broader outlook which they considered valuable 
to a writer and 2 felt that their interest had been awakened 
in certain economic problems. One had fomid the course in 
Accoimting o£ practical assistance. One had been helped in 
tinding materiale and another regarded his conrses as a good 
f omidation for further study. 

Quotations from Journalists j Editors j etc. 

No. 276. A.B. (summa cmn laude) Class of 1907. Eco- 
nomics i, 14a, and 14b. Bureau of Education, Wash- 
ington, D. C. 

I still consider Economics i probably the most valuable course 
I took in college. For my present work in surveying the general 
educational field it was indispensable. . . . The opportunity to 
get different points of view, as represented by diff erent men — 
Taussig, Andrews, Ripley, etc. — was espedally valuable. 

No. igi. A.B. Class of 1903. Economics i, 6, 9, 18, and 
21. With . . . and Company, educational publishers. 

Courses 9, 18, and 21 have all been valuable in my vocation. 
Economics 9 gave me an imprejudiced view of the labor problem 
before I came in contact with tiie view of the employer. 18 was 
valuable because in executive work I have constant need to know 
the meamng of accoimts, how to construct them so as to show the 
actual condition of business, and how to interpret them. The 
study of cases in Economics 21 was good mental drill and training 
for business lif e. The case method gave me a good idea of what 
the common law is and how an attomey gæs to work to make 
up his case. All my coinses in Economics were among Harvard's 
most valuable contributions to my "Uberal education." 

The Value of Economics Courses to Educators, Professors y 

TeacherSy and Ministers 

Of this group 18 took Economics i only, 10 took two 
courses, and 24 took three or more courses. Thirteen were 
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graduated before 1900, 26 between 1899 and 1908, and 13 
from 1908 to 1913, indusive. Nine were professors of 
Economics. Foiir (8 per cent) made no comment on the 
value of the coiirses to them. 



Value in Vocaiion 

Number Per Cent 

Number of replies considered 52 — 

Deddedly advantageous in vocation . . 8 15 
Favorable comment, moderate or uncer- 

tain statements 10 19 

Vigorous adverse comment 2 4 

Adverse, less vigorous comment .... 3 6 

Totals: Advantageous 18 35 

Of slight value if any .... 5 10 

No comment made 29 56 

Social or Civic Values 

Number Per Cent 

Number of replies considered 52 — 

Deddedly helpful in these respects. . . 4 8 
Favorable comment, moderate or xmcer- 

tain statements 14 27 

Deddedly adverse comment z 2 

Adverse, less dedded comment .... i 2 

Totals: Favorable comment 18 35 

Of slight value if any .... 2 4 

No comment made 32 62 

General Culture Values 

Number Per Cent 

Number of replies considered 52 — 

Deddedly helpful in these respects. . . 6 11 
Favorable comment, moderate or xmcer- 

tain statements 28 54 

Vigorous adverse comment z 2 

Totals: Courses helpful 34 ^ 

Of slight value if any .... z 2 

No comment made ij 33 

The repKes from this group are usually very brief and 
many of them are unsatisfactory because the statements 
tend to be very general, sometimes imcertain m meaning, 
and are rarely concrete or objective. 
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Fifteen (29 per cent) found their courses helpful in form- 
ing opinions on political issues. Eleven (21 per cent) were 
heiped in solving social problems or in conducting sociolog- 
ical investigations. Several of these were ministers. Eleven 
(21 per cent) felt that new interest had been aroused in 
questions of which they were previously ignorant, or that 
their outlook had been broadened. Six (12 per cent) were 
better able to understand "current economic problems." 
Eight (15 per cent), who were not teachers of Economics, 
had gleaned information from the courses which had been 
useful in presenting their own work in schools or colleges. 
Among those who used such information, one was teaching 
English, one Agriculture, and another History. Five (10 per 
cent) spoke of having received training in reasoning or in 
critical thinking (mental discipline). Four (8 per cent) 
mentioned "cultiural values." Four others were better able 
to understand business affairs or had received a "general 
training which was useful in the business affairs of life." 

Three (6 per cent) regarded their study of the subject as 
having provided the basis for much of their present trend of 
thought or as having altered their outlook upon life. Three 
were led to do f urther reading or were stimulated in a desire 
for "more cultiure and information." Two regarded their 
courses as a general introduction to the field of economics. 
Two mention the course in Accounting and one the course 
in Banking as having been of material assistance in practical 
affairs. 

Qtu>tations 

No. 151. A.B. (cmn laude) A.M. LL.B. Class of 1906. 
Economics i, 2, 3, 6, 12b, and 16. Lecturer on economic 
subjects. 

Economics 2 in particular was extremely stimulating to 
critical thinking. A certain amount of Economics is absolutely 
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essential ... to show the superfiicial but cocksure ignorance 
of the average successful lawyer or business man in discussing 
public afifairs. 

No, 24. A.B. (cum laude) A.M. Class of 1901. Eco- 
nomics i, S, 6, 7, 9, 17, and 20. Education. Adminis- 
tration. 

The course in Accounting has been of great practical value 
both during a year and a half in a raihoad office and since in 
School Administration. Some scraps of information have been 
valuable in my teaching but my real profit from the courses was 
through personal association with men like Ashley, Dunbar, 
and Taussig. I consider my work in Economics cultural and 
not vocational. It was the historical courses that I valued most 
highly. 

No. 81. A.B. (cum laude) A.M. Ph.D. Class of 1901. 
16 courses in Economics. Assistant Professor of 
Economics. 

The courses I took at Harvard have been of value from the 
point of view of content and training in the work. They awoke 
or strengthened my interest in the subject, and of course greatly 
influenced my whole outlook on life. It is not easy to distin- 
guish in other ways between this preliminary training and the 
work I have done since. 

No. 141. A.B. Class of 1894. Economics i. Minister. 

No course taken in college has proved more valuable. For 
twenty years I have been active in social, dvic, and labor work. 
As a minister and social worker I have many times been thank- 
f ul for the elementary training in economic reasoning afforded 
by Economics i. 

No. 250. A.B. (Comell) A.M. 1905. Ph.D. Several 
courses in Economics. Associate Professor of Sociology. 

Naturally the courses taken have been of direct value to me 
in my work as a teacher. Quite as naturally, perhaps, I find 
them of direct use in my activities as a citizen. They give added 
interest in following political and social movements. 
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The Value of Economics Courses to Business Men^ Including 

Bankers j Brokers, Merchants^ ClerkSy Salesmeny 

Advertisement Writers, BuyerSy and 

Insurance Agents 

Of this group lo took Economics i only, lo took two 
courses, and 32 took three or more courses. Twenty-one 
were graduated before 1900, 20 between 1899 and 1908, 
and II from 1908 to 1913, indusive. 

Value in Vocation 

Number Per Cent 

Number of replies considered 52 — 

Deddedly advantageous in vocation . . 6 12 
Favorable comment, moderate or uncer- 

tain statements 22 42 

Vigorous adverse comment 3 6 

Adverse, less vigorous comment .... 2 4 

Totals: Helpful in vocation 28 54 

Of sligfat value if any .... 5 10 

No comment made 19 37 

Social or Civic Vatue 

Number Per Cent 

Number of replies considered 52 — 

Helpful in these respects 12 23 

No comment made 40 77 

General Ctdture Values 

Number Per Cent 

Number of replies considered 52 — 

Deddedly helpful in these respects. . . 4 8 
Favorable comment, moderate or uncer- 

tain statements 29 56 

Totals: Favorable comment 33 64 

No comment made 19 37 

Fourteen (37 per cent) found Accounting a highly valu- 
able subject. Several suggest that this course should be 
compulsory for those who expect to be business men or 
lawyers. Four think that the course might have proved 
very much more helpful if it had been conducted in a diflfer- 
ent way. (See Suggestions on Economics 18.) Five (10 
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per cent) speak of the work on banking as having proved 
of practical assistance. Four (8 per cent) were helped by 
courses on railroads or transportation. Six (12 per cent) 
mention "valuable mental training" or say that they were 
helped to think in a "practical way." Six (12 per cent) 
were better able to form correct views on cnrrent economic 
questions. Five (10 per cent) mention social problems and 
seven (14 per cent) speak of political issues in the same 
way. Fonr were able to gain a foothold in business with 
less difficulty because they understood technical terms and 
underlying principles. Five regarded their courses as havmg 
paved the way for more general reading and study along 
economic lines. Three were better able to find articles or 
look up data bearing on the problems which they had to 
solve. Four valued the courses for a broad outlook upon the 
business world. Three had gained a conception of the 
underdeveloped resources and possibilities of future growth 
of the United States which had helped them in business. 
Only two valued their courses as part of a liberal education. 
One had been helped in managing the economic affairs of 
his household. 

Qtwtations 

No. 186. A.B. Class of 191 1. Economics i, 5, 18. Bond 
Broker. 

The courses in Economics have proved more valuable to me 
than all the rest of my college course. The course in Railroads 
affects me directly in my business. Economics 18 is of the ut- 
most value to me, and I refer to Mr. Cole's book often. These 
courses teach you to think in a more practical way than any 
other subject can and they give you a foothold in any business. 

No. 249. A.B. Class of 1913. Economics i, 6a, 6b, 18, 
and others. Fruit Grower. 

Out of six or seven courses in Economics, I got nothing from 
any particular requirement, but rather gained a broader out- 
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look on life through the greater field of vision gained from the 
whole course. . . . My business calls for planting trees on 
hitherto unbroken ground. Many people have said that I 
would get discoiuraged, that it could not be done profitably, 
etc. ... I believe that every Harvard man who has taken 
any courses in Economics or Philosophy gets and alwa)rs 
keeps with him an imagination, an outlook on life that 
always gives him hope and courage to be able to find a way 
to do anything. 

No. 8. A.B. Class of 1911. Economics i, 8a, 8b, 18, 21, 
and 23. Citrus Fruit Grower, Califomia. 

Economics i was possibly of some help in labor problems, 
possibly of help in imderstanding public questions. ... I was 
able to make considerable use of Economics 18 in revising the 
cost accoimting on the ranch and expect to get a lot more help 
in the future in the same line. . . . Courses 8a, 8b, 21, and. 23 
have been of little if any practical value except that I f eel that the 
general mental training in seeing things from a broader economic 
viewpoint is often of considerable indirect value. 

Value of Economics Courses to Farmers and Foresters 

Of this group i graduated before 1900, 2 between 1899 
and 1908, and 6 from 1908 to 1913, inclusive. Two took 
Economics i only, i took two coiirses, and 6 took three or 
more courses. 

Value in Vocation 

Number Per Cent 

Number of replies consideied 9 — 

Deddedly advantageous in vocation . . i 11 
Favorable comment, moderate or uncer- 

tain statements 5 56 

Totals: Favorable comment 6 67 

No comment made 3 33 

Social or Civic Valnes 

Number Per Cent 

Nmnber of replies considered 9 — 

No comment made 9 100 



Number 


Per C 


9 


— 


I 


II 


S 


S6 


6 


67 


3 


33 
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General Culture Values 

Number of replies considered ..... 

Decidedly helpful in these respects. . . 

Favorable comment, moderate or uncer- 

tain statements 

Totals: Favorable coroment 

No comment 

Two foiind the coiirses valuable because they gave a new 
Outlook upon life and enabled the student to see things from 
a different point of view. Two were helped in solving 
politicai problems and 2 had received valuable mental 
training. One regarded the courses as part of a general 
education, one had been helped by understanding the laws of 
tråde, and one had made good use of the coiurse on Accoimting 
(Economics 18). 

Value of Economics Cour ses in Various Vocations 

I n m IV V VI vn 



M Éi -H §|lg lill SS il 

Vocational 39 56 7 60 35 54 67 

Social-Civic 26 17 47 40 35 23 22 

General Culture .... 70 50 53 60 66 64 67 
Forming Opinions on 

Political Issues ... 13 22 33 o 29 14 22 
Social Problems, Current 

Economic Questions .25 17 17 20 21 12 o 
Habits of Thought; 

Mental Disdpline . . 16 11 o 30 10 12 o 

Accounting 10 11 o zo 4 37 iz 

Banking 4 o Z3 o 2 zo o 

Further Reading and 

Study zo 6 7 zo 6 zo . o 

Number in the Group . 72 z8 Z5 zo 52 52 9 

Notes: Groups m, IV, and VII are too small to admit of any important con- 
clusions from the results. The subjects tabulated are points explicitly mentioned 
in the replies as values resulting from the courses and do not include inf erences 
which might readily be drawn in many cases from the nature of the replies. 
Figures represent percentages of total number of replies from the given vocation. 
The columns do not total zoo per cent because the headings overlap in several ways. 



I 
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Section Meetings and Assistants 

Fif ty-three men comment on the section meetings or the 
assistants. Thirty-two of these criticize the assistants or 
the method of conducting the sections. Nineteen make 
favorable comments and 2 speak favorably of the section 
meeting but adversely of the assistants. Many of those who 
criticize the section meetings most severely express them- 
selves as on the whole favorable to the idea. Their comments 
are usually aimed at the method of conducting the meetings 
or at the assistants rather than at the system itself . In 
many cases general statements are made conceming the 
inefifectiveness of the sections without specifying what the 
defects were. 

Seven believe that the instructors were so engrossed in 
their graduate studies or other work that they did not take 
the time to do the necessary amount of reading on current 
economic questions. Seven make mention of the faet that 
the assistants were impractical or limited in point of view. 
Five repUes insist that more experienced men be placed in 
charge of the sections and 4 point out that the assistants 
lacked teaching experience. 

Eight think that more time should have been taken for 
discussion on the part of the students. Only one man says 
that the discussion drove home the points touched upon in 
the lectures and stimulated an interest in the weekly assign- 
ment of reading. Two say that the section meeting was 
conducted as a means of finding out whether the prescribed 
reading had been done, and 2 others believe that there was 
much wasted effort in memorizmg the work in a certain order 
due to the mechanical questions asked. Two think that the 
papers were graded as "task jobs" by the assistants and 
were not given proper consideration. Two suggest that the 
discussions were not properly correlated with the lectures. 
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Two regard the section meeting as a waste of time because 
a large group had frequently to wait while attention was 
given to an individual whose difficulties were not common to 
the others. 

Two say that their instructor was of unusual abihty, one 
that the papers were fairly and carefully marked, and one 
that the debate was foimd helpful. 

Qtu>tations 

No. 226. A.B. (sununa cimi laude) Class of 1905. A.M. 
Economics i, 2, 5a, 5b, 6a, 6b, 8a, 8b, 9, etc. EflSciency 
Expert, Manufacturing. 

An extension of dass discussion under the guidance of a 
master of his subject would drive the prindples of the several 
courses more deeply into the students' minds. The section- 
meeting system does not answer this purpose. All honor to the 
Austin Teaching Fellows; they struggle manfully with their 
little sections and answer admirably the purpose of making 
some of the students inhale the weekly outside readings; but 
they do not get imder the skin of the undergraduate. I re- 
member more of the courses imder Professor Taussig and Pro- 
fessor Carver in which these full grown men directed the dass 
discussions than I remember of any two other courses which 
consisted entirdy of lectures or of two lectures plus one section 
meeting under a fledgling. . . . Suppose one or more of the full 
professors were each to take one of the sections each week. 
Every section would thus get a thick slice of the professional 
cake several times a year. The professor, by devoting the en- 
tire hour to spirited discussion, would leave a lasting impression 
on the minds of the students. 

No. 2ig. A.B. (magna cimi laude) LL.B. Class of 1908. 
Economics i, 2, and 6b. Lawyer. 

Of the courses I took the one that to my mind could and 
should be improved was Economics i, with regard to the work 
in the sections. Whether this was the fault of the assistants 
who had charge of the sections, or whether it was inherent in a 
course in a subject which is new to most of the men taking it, 




138 THE TEACHING OF ECONOMICS 

I do not know, but at least until the first hour-exams, the scope 
and idea of the entire subject was rather hazy to most of the 
men I knew. Personally, I did not find that the section work 
supplemented the lectures and outside reading as it should 
have. 

No. 200. S.B. (cmn laude) Class of 191 1. Economics i, 
5, 18, and 28. With . . . Railroad. 

The assistant in this case was a graduate of a smaller college 
who was working for a Ph.D. He was totally out of sympathy 
with his students, and he was positively a detriment. This 
is the main f ault with the assistants — they don't care, take no 
pride in their duties, and work merely because it is a mild way 
of paying for their tuition. ... I condemn the system of using 
imsuitable assistants in the courses. 

No. 165. A.B. (cnm laude) Class of 191 2. Economics i, 
4b, 6a, 6b, iib, 12, and 16. Law Student. 

One point which in my opinion cannot be overemphasized, is 
the need of having assistants in the larger courses who are in- 
terested in the subject and in their students, and who are able 
to guide the discussion in section meetings so that it becomes 
more than a mechanical test of the retentiveness of the student's 
memory and the amoimt of time he has put on his work. If the 
student is led to antidpate a lively discussion in section meet- 
ing, his preparatory work immediately takes on a different 
aspect. He looks for intellectual problems that he knows he 
will have to grapple with and casts about in his own mind for 
arguments which he can use in the dass room. The deadening 
effect of an assistant who merely tries to find out if youVe done 
the prescribed reading is enough to spoil one's interest in any 
course on Economics. 

No. 6. A.B. (cum laude) Class of 191 2. Economics i, 4a, 
4b, and 6a. Newspaper (Editorial Department). 

The men who serve as assistants are for the most part im- 
practical men. In writing a thesis on a present-day subject, a 
man needs some guidance from men who have a more practical 
tum of mind. Theoretical anal)rses are not alwa)rs suffident. 
I met young instructors who were so engrossed in their graduate 
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work or in the theoretical prindples of Economics that they 
apparently found little time to read the newspapers or current 
magazines. 

No. 22g. LL.B. Class of 1912. Economics i, 2b, 3, 4, and 
18. Lawyer. 

The manner in which the instructors (not the professors) 
graded theses as task jobs and with no attempt to recognize or 
preserve original research leads one to give them what they 
seem to want — i. e., a hackneyed piece of work of so many 
pages that is easy to read (a typewritten thesis being sure of a 
passing grade). In one case, I deliberately copied a thesis from 
a book of a former Harvard Professor in the same course and 
received an A on it. Needless to say that ended my interest 
in thesis courses. 

No. 276. A.B. (summa cum laude) Class of 1907. Eco- 
nomics I, 14a, and 14b. Editor. 

The review section with its discussion of the lectures and 
readings of the week was stimulating, possibly because the 
section-man was considerably above the average of the as- 
sistants. 

Practical Applications 

The f ollowing paragraphs elaborate the data given above 
imder the head of Suggestions and CriticismSj part (a). 

Sixty-three men criticize in various ways the practical 
applications made in the Economics courses. Thirty-five 
of these state that in nearly all courses more emphasis ought 
to be placed upon practical problems of the present day. 
They seem to think that for the great majority of students 
the matter dealt with was too theoretical, philosophical, or 
historical, and had too little concrete application to problems 
with which the classes could be expected to be familiar. 
Discussions of a theoretical character appear to have left 
little or no impression imless they were applied to actual 
conditions through theses, discussions, or investigations 
on the part of the student. In this connection it may be 
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interesting to note that ten replies were received containing 
statements to the efifect that the writers had forgotten all 
of the material leamed in Economics and that so far as they 
could see they had derived no benefit from the study. Two 
of these admit that they did not study as they should have 
done and received passing grades by cramming for examina- 
tions. (These ten are not included in the 63 tabulated 
above.) 

^Seven suggest that visits be made to banks, stock ex- 
changes, factories, and various business houses in order to 
give the students the needed contact with the business 
world. Several suggest that speakers from the outside be 
brought in to lecture on the fieids in which they have proved 
successful. Three believe that there should be illustrations 
of the actual transactions of banking, stocks and bonds, etc, 
for the sake of students who have had a limited experience 
or a deficient secondary school preparation. Debates on 
contemporary issues are frequently spoken of as a good 
means of arousing interest and stimulating further study. 

Among the topics which are mentioned as being neglected 
are: labor problems from the employer's point of view 
(6 replies); socialism (5); foreign exchange (i); scientific 
management and business organization (i); single tax (i). 
Four men want the department to do more toward teaching 
correct ideals of citizenship and 3 think that more should 
be done toward combating the propaganda of the radical 
press. 

Two want the principles expoimded by Mill more thor- 
oughly applied to modem times and i thinks that the time 
spent in reading Spencer was entirely wasted. Two think 
that students get a false conception of the significance of 
present-day problems due to the predominance of theoretical 
and historical discussions. 

Two think that it would be helpful to present a brief 
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summary or survey of the principal factors in our own 
economic system in order that the student may have some 
concrete foimdation upon which to base his later theoretical 
study. Three suggest that students be earlier familiarized 
with the current literature on economic questions both in the 
technical and in the popular periodicals. Two are of the 
opinion that much valuable aid could be rendered graduates 
by the publication of annotated bibliographies of current 
economic literature. Lack of guidance from mature, 
practical men in selecting courses and in writing theses 
was felt to be a serious fault by two persons. 

Qtu>tations 

No. j8. A.B. Class of 1906. Economics i, 2, and two 
other courses. Mining Engineer. 

Wherever possible, an application of economic prindples to 
present-day conditions wiU do more to emphasize the import- 
ance of the theory and to impress the same on the mind than 
any amount of "extra reading" or thesis work. A free discus- 
sion of economic theory from all angles is the best possible in- 
centive to study. I got more out of conferences, I think, than 
out of all the rest of the work. The instructor allowed a certain 
amoimt of informality and toward the end debate was pretty 
strong. One excellent feature is to encourage independent ideas 
and bring them up for discussion. 

No. 56. A.B. A.M. (Bis.) Class of 1891. Economics i 
and 2. Lawyer. 

I think the aim should be, without diminution of training in 
sound economic thinking, to develop real economists who are 
in touch with modem conditions, particularly in the United 
States. As one who took Economics as a mere side issue, and 
as a Citizen who is profoundly interested in the problems of to- 
day, I feel the country's sore need of broad-minded, well- 
grounded, well-informed, up-to-date economists. I am sorry 
to say that I think there are few in the coimtry. Those who 
profess to be economists are too nearly exclusively concemed 
in the far-away and the highly theoretical. Whether the col- 
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lege can do anything to remedy this, I don't know. I think it 
ought to try and try hard. 

No. 125. A.B. (cmn laude) A.M. Class of 1903. Eco- 
nomics i. Teacher. 

I should suggest . . . that the conf erence questions be applied 
to matters concrete enough to reach the life-interests of the 
student. On one of my pages I find the question, "Can a con- 
vertible paper currency become permanently redundant?" I 
cannot help having a good deal of curiosity as to what I did 
with that question on my paper. 

No. 149. LL.B. Class of 1903. Economics i (repeated). 
Lawyer. 

I took the course twice. . . . It was more or less unintelli- 
gible both times but at the second try I got through. I think 
the trouble was that I had no practical knowledge of banking 
or commerce and didn't know any of the methods or fimda- 
mental facts. It seems to me that a certain amoimt of practical 
instruction at the beginning . . . would be very useful. You 
can't expect a man to comprehend the first prindples of Eco- 
nomics when he does not know the difference between a promis- 
sory note and a draft. I do not think that I am abnormally 
stupid, but I do not think that Economics i, as taught, was of 
any value to me at all. 

No. 166. A.B. (University of Kansas) A.M. Economics 
I, 2, 4, 5, 6, 7, 8, and 20. Farmer and lectnrer on 
Economics. 

My general criticism is that most of the courses were not as 
practical as they should be; depended too much on theories or 
principles which when I have tried to apply them frequently 
did not fit. . . . College teaching is not close enough to busi- 
ness life and activity. ... I have leamed more helpful eco- 
nomics from my farming experiences and from talking with 
business men than I did at Harvard. 

No. 193. A.B. (cimi laude) Class of 1909. Economics i, 2, 
6a, and 6b. Editor, Lecturer. 

Having come to college at a more mature age than most of 
my class-mates and af ter some years' experience in metropolitan 
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joumalism, I was constantly irritated during my courses in 
history, economics, and govemment by the failure of teachers 
to relate class room material to current events. Students were 
not made to feel the vitality of the subjects under discussion. 
Present-day applications, references to new developments in a 
certain field, comments which showed that the teacher had 
read his morning newspaper were rare indeed and, in the case 
of some teachers, altogether absent. Student interest was in- 
variably stirred by such references. . . . (Economics 2). The 
conclusion to which I have come is that economic theory has 
absolutely no bearing on the facts of life except over "long-time 
periods." And since 99 per cent of himian concem is with 
"short-time periods," economic theory confounds rather than 
clarifies. I wasted a lot of time and thought trying to recon- 
cile professorial conclusions with reality. I should strongly 
advocate a more honest admission that economic theory is 
largely a survival of the brightest in an intellectual prize fight 
over a definition of terms. 

No. 22^. A.B. (cmn laude) Class of 1909. Economics i, 2, 
6a, 6b, and 18. Meat Packer. 

In general (speaking only of courses for my time at college), 
I should suggest that the Department of Economics deem itself 
responsible for presenting to the young men, a large majority 
of whom are going to enter business, as faithful as possible a 
picture of modem business organization, its untold scientific 
possibilities, and the high ideals that can pervade it. They 
cannot in this work do without the assistance of the high-grade 
business man, who is the man who knows the problems, and 
who would be glad to address the students. 

No. 228. A.B. (cum laude) Class of 1891. Economics 
I, 2, and 6. Lawyer. 

K a piece of legislation like the Rural Credits Bill had been 
given me for investigation and report, I should have been in- 
finitely more benefitted than by digging into the economic as- 
pects of the South Sea Bubble. When it is so easy for the prac- 
tical to assist the theoretical, it should constantly do so. There 
is no reason for Economics to be a "dismal science" if it is co- 
ordinated with contemporary affairs. A student of forestry 
seeks the forests; not all studies have forests to observe, but the 
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whole world every moment offers conditions and events for 
the information and observation of the student of political 
economy. 

No. 286. A.B. (magna cum laude) Class of 1907. Eco- 
nomics i, 18, and two others. Accountant. 

Like most other college students, I was more interested in 
applied economics than in eænomic theory. The prindples 
developed in the lectures should be more thoroughly applied to 
actual practical cases in the sections or in thesis work. This 
should be done at every stage of the course; otherwise the prin- 
dples leamed seem of little practical importance and are soon 
forgotten. 

No. 2g8. A.B. Class of 1906. Economics i and several 
other courses. Boston Merchant. 

In vocational training the courses given at Harvard are pain- 
fully weak in my opinion, and largely so because they are so far 
removed from the public contact that real business training 
needs. They seem more to train the mind to meet situations 
that may arise in the business world than to offer actual con- 
tact wi^ these situations. . . . If the college could induce 
200 business houses to take one student for a month, and let 
him stay a week or more in each department, they would be 
adding a value to the Economic and Business courses that they 
do not now possess. 



B. From Students 

I. The number of replies to this questionnaire was 546 — 
a large proportion of the total number distributed, certainly 
much over half , although the exact percentage cannot be 
given because a considerable nimiber of students received 
the blanks in several courses. There were 1007 registra- 
tions in Economics courses in March, 1915, which means, 
possibly, 850 individuals, not over 800 of whom could 
have received the questionnaires. The total is large enough 
to provide a good survey of opinion among students of 
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Economics in the College. The whole nmnber was divided 
as f oUows : 

Students taking Economics A only 308 

Undergradiiates taking courses more advanced 

than Economics A 208 

Graduate students 30 

2. The degrees for which these students were candidates 
were: 

(a) Students taking Economics A only: 

Candidates for A.B 257 

" " " S.B 41 

" " " A.A I 

Not candidates for a degree 4 

Notlisted S 

308 

(b) Undergraduates taking advanced courses: 

Candidates for A.B 185 

" " " S.B 23 

208 

(c) Graduate Students: 

Candidates for A.M 12 

" " " Ph.D II 

Not a candidate for a degree .... i 

Notlisted 6 

Of the total number (546), about 80 per cent were 
undergraduates in regular standing. 

3. The classes in which these students were registered 
were: 

(a) Economics A: 

Seniors (1915) 20 

Jimiors (1916) 82 

Sophomores (1917) 173 

Freshmen (1918) 6 

Unclassified 26 

Spedal I 

308 
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(b) Advanced counes: 

Senion 80 

Jimiora loi 

Sophomores 23 

Undassified 4 

208 

(c) Graduale students: 

First Year 20 

Second 6 

Thiid 2 

Fouith I 

Notstated i 

4. Intention to pursue Economics further is shown by the 
foUowing figures: 

Undonaduatet Undeignulaatet 

taking Economict taking Advanced Graduate 

Aonly Counet Students Totals 

Yes 132 86 7 225 

No Z07 68 6 181 

Undedded . . 51 zo 5 66 

Noanswer . . 18 48 12 78 

5. Concentration in Economics was indicated as foUows: 

Students taking Students taking 
Economics A onqr Advanced Couises Totals 

Economics 40 95 135 

Economics and Govenmient .... 14 17 31 

Economics and Histoiy 6 8 14 

Economics, Govenmient, and Histoiy 5 zi z6 

Economics, Philosophy, and Social 

Ethics — z z 

Economics and Philosophy .... — z z 

Totals 65 Z33 Z98 

6. Candidates for degrees with distinction in Economics 
appeared as f oUows : 

Students taking Students taking 
Economics A amy Advanced Courses Totab 

Economics 6z 24 85 

Economics and Govenmient .... z 2 3 

Economics and Histoiy o z z 

Economics, Government, and Histoiy 358 

Economics and Philosophy . . . . z 3 4 

66 35 zoz 
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7. The occupations into which these students expected to 
go were : 





Students takliur 
Economics A omy 


Students taking 


Gnduate 






Advanced Courses 


StudenU 


Totals 


I. Business . . 


68 


92 


— 


160 


2. T^w . . . . 


57 


43 


I 


lOI 


3. Teaching . . 


24 


6 


20 


SO 


4. Engineering 


16 


2 


— 


18 


5. Medicine . . 


16 


2 


I 


19 


6. Banking . . . 


13 


12 


I 


26 


7. Chemistry . . 


II 


S 


— 


16 


8. Joumalism 


8 


4 


I 


13 


9. Ministry. . . 


5 


— 


4 


9 


10. Agriculture . 


3 


S 


I 


9 


II. Theatre . . . 


3 


— 


— 


3 


12. Efl&dency En 


- 








gineering . 


2 


I 


— 


3 


13. Mining . . . 


2 


I 


— 


3 


14. Architecture 


2 


— 


— 


2 


15. Public Servia 


5 2 


— 


— 


2 


16. Consular Ser 


- 








vice . . . 


2 


2 


I 


S 


17. Advertising . 


I 


— 


— 




18. Politics . . . 


I 


— 


— 




19. Geologicai 










Survey . . 


I 


— 


— 




20. Biological Re 


- 








search . . 


I 


— 


— 




21. Electridty . . 


I 


— 


— 




22. U. S. Anny . 


I 


I 


— 




23. Accountancy. 




I 


— 




24. Government 










Admin. . . 


— 


I 


•— . 





Ninety-six men were undecided: 11 Seniors, 31 Juniors, 
50 Sophomores, i Freshman, 3 Unclassified. Sixty-eight 
of these men were taking Economics A only. 

The occupations chosen were divided for certain purposes 
of comparison into two groups — first, the group for which 
Economics is commonly supposed to be preparatory — 
Business and the Law; second, the group for which Eco- 
nomics is not commonly supposed to be preparation — 
Engineering, Medicine, Agriculture, etc. The purpose of 
this division was to see whether students intendiaAÉi^Bater 
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the Law or Business expect more direct help from Economics 
courses than do the others. Teaching, Joumalism, the 
Ministry, Public Service, Consular Service and PoKtics, 
all occupations in which knowledge of Economics might be 
highly useful, were omitted from the count of the second 
group, in order that the contrast, if any appeared, might 
be sharply drawn between the clearly vocational outlook 
and the clearly non- vocational outlook of the students in 
the two groups. When an answer was equivocal it was 
put with one group or the other only when all the possibili- 
ties suggested fell within that group. 
The groups campared tkus as to numbers: 

Vocational Non-Vocational Neutral Not 

Group Group Group Grouped 

Students taking Economics A only . 150 57 42 59 

Students taking Advanced courses . 155 18 12 23 

Graduate Students 2 2 26 o 

307 77 80 82 

According to this grouping, concentrations in Economics 
and in Economics and other Subjects divide as foUows: 

NON-VoCAnONAL 

VocAnoNAL Group Group 

Ils ^ is. Il 



5 ol ^ii I ^l-t 5|S 

d 2 o a> S £ fl § o o> 5 

1& 1^ Il ^^ 

CO CO CO CO 



5 



Economics 32 74 zo6 033 

Economics and Govenmient 9 16 25 000 

Economics and Histoiy . . 4 7 11 o 11 
Economics, Govenmient and 

History i 9 10 o o o 

Economics and Philosophy .0 i i 000 

Concentrations in Economics and in Economics and other 
subjects fall overwhelmingly in the vocational group. As will 
be seen from the table imder the f ollowing heading, this group 
expects of the instruction help in vocations more frequently 
than does the other, but direct help only about as much. 
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8. The help expected by the students in their several 
vocations may be seen from the f oUowing figures : 



9 



S s® 

•c s 



Ui 



Directly helpful . . 

Indirectly helpful . 

Not helpful .... 

No answer or too 
equivocal for 
record .... 
Totals .... 



48 

158 

39 



63 
308 




33 

208 



S 
30 



I 



109 

285 

SI 



zoz 
546 



h 

•SS 

> 



67 
216 

19 



5 
307 



I 

u 

I 



so 
z6 



4 
77 



1 



o 



3S 

19 
16 



S o 3 O. 



10 
80 



82 
82 



ja 



109 

28S 

SI 



lOI 

S46 



Of the whole number of students 73 per ænt expect help; 20 per ænt direct 
help; 53 per cent indirect. Of the vocational group 92 per cent expect help; 
22 per cent direct; 70 per cent indirect. 

9. The chief reasons given for taking Economics conrses 



were : 

« Q 

11 

en 

1. Expected courses to be directly helpful in 

vocation 25 

2. Expected indirect help through a know- 

ledge of prindples, etc 57 

3. In order to understand elementary eco- 

nomic prindples 30 

4. As part of a general education, for informa- 

tion or broader vision 51 

5. For mental training or methods of reason- 

ing 13 

6. For a better imderstanding of affairs of 

theday 17 

7. For citizenship, better imderstanding of 

politics or legislation ix 

8. For a better imderstanding of social 

problems 30 

9. For a better imderstanding of financial, 

industrial, and legislative problems . . 29 

10. For purely cultural values zo 

zz. Because of natural interest in Economics . 12 

Z2. To fill out college Schedules 32 



11 



B 

CO 



37 

33 
10 

2X 

x8 

21 

7 

13 
19 

2 
38 

9 



SI 



8 



^ 



3 

2 

X 

6 

2 
2 

z6 
o 



70 
92 
40 
73 
34 
40 
19 
49 

SO 

14 
66 

41 



C 
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10. The specific reasons for taking particular courses 
could not be distinguished from the general reasons for 
studying Economics. Apparently the students did not 
dififerentiate clearly between their general purposes in 
studying the subject and the ways in which special courses 
might serve those purposes. 

11. The advice or information because of which courses 
were chosen appears from the f oUowing figures : 

Students takio« Students taking Gnduate 

Economics A onqr Advanced Couises Students Totals 

Facnlty Advisor .23 21 o 44 

Member of the 

8 19 16 43 

z I 02 

z o 01 

8 Z4 o 22 

9 33 4 46 



Faculty . . 
Senior Advisor 
Tutor . . . 
Relatives . . 
Catalogue . . 
Reputation of the 

Course .... 39 41 4 84 



Total number of statements conæming souræs of advice or information 242 

12. The most helpful courses in other Departments (with 
respect to the study of Economics) were listed thus : 





Students takinc 
Economics A omy 


Students taking 


Graduate 






Advanced Couises 


Students 


Totals 


Govenmient 31 . 


2 


3 


— 


S 


English 


S 


— 


— 


S 


Physics 


3 


2 


— 


S 


Geology .... 


2 


3 


— 


S 


History 30 . . . 


z 


S 


— 


6 


" 32b .. . 


S 


— 


z 


6 


" 32 . . . 


— 


7 


— 


7 


Government 17 . 


z 


6 


— 


7 


Chemistry . . . 


5 


2 




7 


Modem Languages 


z 


7 


— 


8 


Psychology . . . 


S 


S 


z 


zz 


Government 9 . . 


S 


7 


— 


Z2 


English A . . . . 


zz 


3 


— 


14 


History 10 . . . 


7 


9 


— 


z6 


History 13 . . . 


8 


14 


— 


22 


Mathematics . . 


z6 


14 


— 


30 


Government . . . 


19 


zo 


2 


31 
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Students taking 
Economics A on& 


Students taking 
Advanced Couises 


Graduate 
StudenU 


Totals 


Philosophy . . 
Social Ethics . 


13 

4 


16 
23 


3 
8 


32 
35 


Histoiy 


19 


22 


3 


44 


" 1 

A • • • 

Government i . . 


27 
48 


23 

26 


2 


52 

74 



13. TÅe reasonsfor tkis hdpftdness were listed thus: 



lit sil \i i 



•«- ^ 



II 

CO en 

1. Answers too general for classification . . 26 25 3 54 

2. Courses said by student to give training in 

reasoning . 20 8 i 29 

3. Practicalapplicationof economicprindples zo 14 — 24 

4. Gave power o£ expression 14 8 — 22 

5. Gave power of interpretation 4 2 — 6 

6. Historical illustrations and applications of 

economic prindples . . ' 36 39 2 77 

7. "Supplementary values" 4 i i 6 

8. Subject matter — usef ul as introduction to 

and preparation for Economics .... 3 3 — 6 

9. Subject matter parallel or identical ... 12 15 3 30 

10. Methods useful as intrciduction to and 

preparation for Economics 

(a) Practice in plotting graphsand diagrams 7 6 x 14 

{h) Other useful methods not spedfied . . 12 z i 14 

11. Methods parallel or identical o 2 — 2 

12. Help obtained from reading i 5 — 6 

13. Gave a different point of view i 2 2 5 

14. Gave valuable moral or ethical setting . . — 3 i 4 

15. Gave general information i — — i 

14. The difficulties met in the study of Economics are 
shown by the foUowing summary: 

I. Nature of the course or of the instruction: 

(a) Treatment too theoretical 79 

(b) Lack of cleamess in lecture and discussion .... 56 

(c) Lectures not helpful 45 

{d) Valueless discussion 24 

(e) Course hurried, too much ground covered, more time 

for discussion needed 30 

(f) Disregard of other authorities 13 
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2. Lack of facilities: 

(a) Lack of books for assigned reading 52 

(6) Need of a better textbook 40 

(c) Crowded sections 11 

3. Disadvantageoiis requirements: 

(a) Too large or faulty assignment of reading 45 

(6) Too much thesis work 13 

4. Lack of supervision or efficient leadership: 

(a) Need of doser touch with instructors 43 

(b) Need of better section men 42 

5. Miscellaneous: 

(a) Personal incapadty, lack of interest 69 

(b) Unsatisfactory or unfair methods of rating scholar- 

ship 3S 

(c) Misunderstanding of nature of course 13 

15. The relative helpftdness of various phases of the 
work in Economics is summarized bdow. It was possible 
to treat the answers to this question statistically in a 
more elaborate fashion than could be used with the 
other retnms. 

Analysis and Interpretation of Returns to Question 13 
of Questionnaire for Undergraduates 

m 

The question asked was as f oUows : 

Mark in order (i, 2, etc.) the following phases of the work ac- 
cording to their relative helpfulness to you, beginning with the most 
helpful: lectures; class discussions; assigned reading; reports; labora- 
tory; comments or additional information. 

Practically all the students supplied data on this point. 
The distribution of the relative values (in point of helpful- 
ness) assigned by the entire group is that indicated in 
Tables 1-3. 
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TABLE I 

NuMBER OF Students Takikg Courses m Economics Assigiong 
DiFFEiiENT Positions to Various Phases op the Work 

ACCORDING TO THE DeGREE OF " HeLPFULNESS " 



Phase of the Work z 

Lectures 97 

Classroom Discussions 180 



Assigned Reading . 

Reports 

Essays and Theses . 
Laboratory Exerdses 
Comments, etc. . . 
Totals .... 



253 

13 

15 
8 

3 
569 



3 

148 

IS7 

180 

20 

14 

14 

7 

S40 



3 
214 

99 
69 

56 

38 
26 

20 

522 



4 
42 

SS 
22 

78 

39 

32 

42 

310 



5 

IS 
16 

14 
39 
33 
33 
24 
174 



6 

4 

13 

3 
20 

30 

22 

16 

108 



7 

3 
4 
o 

2 
20 
10 

IS 
S4 



4 
6 

I 

z 

4 
2 

o 

18 



Totals 

S27 
S30 
S42 
229 

193 

147 
127 

2295 



TABLE 2 

Per Cents of Students Assigning Different Positions to 

Each Phase of the Work 



Phase of the Work 

Lectures 

Classroom Discussions 
Assigned Reading . 

Reports 

Essa3rs and Theses . 
Laboratory Exerdses 
Comments, etc. . . 



z 
18 

34 

47 
6 

8 

S 

2 



3 
28 

39 

33 

9 

7 
10 

6 



3 

41 
19 
13 

24 
20 

18 

16 



4 

8 

'10 

4 

34 
20 

22 
33 



5 
3 
3 
3 
17 

17 
22 

19 



6 

I 

3 

I 

9 
16 

15 
13 



7 

I 
I 
O 

I 
10 

7 
12 



o 
I 
I 
o 

I 

2 

I 
O 



TABLE 3 

Per Cents of Different Positions Assigned to Different 

Phases of the Work 



Phase of the Work 

Lectures 

Classroom Discussions 
Assigned Reading . 

Reports 

Essays and Theses . 
Laboratory Exerdses 
Comments, etc. . . 



z 

17 
32 

45 
2 

3 

IS 
o 



27 

29 

33 

4 

3 

3 

I 



3 

41 

19 

13 
II 

7 
S 
4 



4 

14 
18 

7 

25 

13 
10 

I 



5 

9 

9 
8 

22 

19 
19 
14 



6 

4 
12 

3 

19 
28 

20 
IS 



7 

6 

7 
o 

4 

37 

19 
28 



o 
22 

33 
6 

6 
22 
II 

o 



From these figures a niunber of things are apparent: 
I. That in the opinion of the undergraduates various phases 
of the work in Economics rank in order: (i) Assigned reading; 
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(2) Classroom discussions; (3) Lectures, etc. II. Apparently 
the other phases of the work are relatively less helpful to 
the students as a whole. III. While these retums can 
represent only the opinions of the students, it is nevertheless 
true that the success of any of the phases of the work is 
conditioned by the attitude which the students assume 
toward it, and therefore the attitude of the students as 
indicated by these retums is important. IV. The retums 
are of course affected by the usual factor of individuel 
difiEerences and the faet that a fairly large proportion of 
the students can be f ound assigmng first place to any of the 
three important phases indicates the supplementary nature 
of those three phases in class work. 

Since it is possible that somewhat advanced students in 
Economics may well find a phase of the work particularly 
helpful which may be less helpful to the yoimger students 
who have not taken work in Economics previously, a 
comparison of the distributions in Economics A alone and 
in other courses in Economics may indicate some important 
difiEerences. The distribution of assignments of value for 
Economics A alone is presented in Tables 4, 5, 6, and for 
students in all other classes in Economics in Tables 7, 8, and 
9. Perhaps the only important diflEerence is to be foimd in 
the faet that the order of helpfulness for students in Eco- 
nomics A alone is first, assigned reading, second, classroom 
discussions, and third, lectures; whereas for students taking 
advanced courses the order of the relative importance is 
first, assigned reading, second, lectures, and third, classroom 
discussion. In other words, for advanced students ap- 
parently the lectures are of much greater value than is the 
case with the students beginning the study of Economics. 
This is shown very definitely in the percentile distribution 
of tables. 
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TABLE 4 

NuMBER OF Students Taking Economics A Assigmng Diffe&ent 
Positions to Various Phases of the Work According 

TO THE DeGREE OF ''HeLPFULNESS" 

Phase of the Work zaa 45670 Totals 

Lectures 24 63 172 30 6 2 2 4 303 

Classroom Discussions .... 134 125 44 12 o 3 o 3 321 

Assigned Reading 164 112 29 3 7 i o i 317 

Reports 2 2 19 26 iz 11 z o 72 

Essays and Theses z 3 7 7 8 Z3 10 2 51 

Laboratory Exerdses 3 5 11 10 Z3 4 3 2 5Z 

Comments, etc 3 6 15 33 10 4 4 o 75 

Totals 33Z 316 297 121 SS 38 20 Z2 1190 



TABLE S 

Per Cents of Students Assigning Different Positions to 

Each Phase of the Work 



Phase of the Work 

Lectures 

Classroom Discussions 
Assigned Reading . 

Reports 

Essays and Theses . 
Laboratory Exerdses 
Comments, etc. . . 



X 

8 

41 
52 

3 

2 

6 
4 



21 

39 

35 

3 
6 

10 

8 



3 

57 

14 

9 
26 

19 
22 

20 



4 
10 

3 

I 

36 

14 
20 

44 



5 

2 
O 
2 

15 
18 

26 
13 



Z 
Z 
O 

15 
26 

8 
5 



7 

z 
o 
o 
z 

20 
6 

5 



z 
z 
o 
o 

4 
4 
o 



TABLE 6 

Per Cents of Different Positions Assigned to 
Different Phases of the Work 



Phase of the Work 

Lectures 

Classroom Discussions 
Assigned Reading . 

Reports 

Essays and Theses . 
Laboratory Exerdses 
Comments, etc. . . 



7 
40 

50 
I 

o 

I 
z 



20 

40 

35 

z 

I 
2 
2 



3 

58 

15 
10 

6 

2 

4 
5 



25 
zo 

3 
22 

6 

8 

28 



5 

zz 
o 

13 

20 

15 
24 

z8 



5 
8 

3 
29 
34 
zi 

zo 



7 
ZO 

o 

O 

5 

50 
15 

20 



33 

25 
8 

o 

17 

17 

o 



iS6 



TEE TEACHING OF ECONOMICS 



TABLE 7 
NuMBER OF Students Taking Advanced Courses in Economics 

ASSIGNING DiFFEXENT POSITIONS TO VaKIOUS PhASES OF 
THE WORK ACCOSDING TO THE DeGKEE OF "HeLPFULNESS" 

Phase ol the Work z 934 5670 Totab 

Lectures 73 85 43 13 9 2 10 334 

Classroom Discussions .... 46 33 55 43 16 10 4 3 309 

Assigned Reading 89 68 40 19 7 3 00 335 

Reports 11 18 37 53 38 9 11 157 

Essays and Theses 14 11 31 33 35 17 10 3 143 

Laboratory Exerdses 5 9 15 33 30 18 7 o 96 

Comments, etc o i 5 9 14 13 11 o 53 

Totals 338 334 335 189 119 70 34 6 1105 



TABLE 8 

Per Cents of Students Assigning Different Positions to 

Each Phase of the Work 



Phase of the Work 



Lectures 

Classroom Discussion 
Assigned Reading . 

Reports 

Essays and Theses . 
Laboratory Exerdses 
CommentSi etc . . 



33 
33 

40 

7 
10 

S 
o 



38 
IS 
30 

13 

8 

9 
3 



s 

19 
36 

18 
24 

33 
16 
10 



S 

31 

8 

33 
23 
23 
17 



4 
8 

3 
18 

18 

31 
37 



I 

S 

I 

6 

13 

19 
23 



7 

O 

3 
O 

I 

7 
7 

31 



O 

3 
O 

I 
I 
O 

o 



TABLE 9 

Per Cent of Different Positions Assigned to 
Different Phases of the Work 



Phase of the Work 



Lectures 

Classroom Discussion 
Assigned Reading . 

Reports 

Essays and Theses . 
Laboratory Exerdses 
Conmients, etc. . . 



31 

19 

37 

S 
6 

3 

o 



38 

14 

30 

3 

S 

4 



19 
24 
18 

16 
14 

7 

3 



4 

6 
33 
10 
38 

17 

13 

5 



5 

8 

14 
6 

24 

31 

17 
13 



3 

14 

3 
13 
24 
36 

17 



3 

13 
O 

3 
39 

31 
32 



O 

SO 
o 

17 

33 
o 

o 
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A further question of interest is whether the better stu- 
dents assign a difiEerent order of values to the various phases 
of the work. Hence, in Tables lo, ii, and 12 is presented 
the distribution of assignments of value for advanced 
students in Economics whose previous work in Economics 
had averaged better than C. It is dear that the order of 
values for the better group of students is apparently lectures 
and assigned reading bidding for first place, with classroom 
discussion a bad third, essays and theses showing a possible 
gain over the distribution in the general group. 



TABLE 10 

NuMBER OF Students Takikg Advanced Courses in Economics Assigning 
DiFFEiiENT Positions to Various Phases of the Work According to 
THE Degree of "Helpfulness" — Better Students Only 



Phaae of the Work 

Lectures 

Classroom Discussion 
Assigned Reading . 

Reports 

Essays and Theses . 
Laboratory Exerdses 
Comments, etc. . . 
Totals .... 



31 

14 

32 

6 

9 

I 

o 
93 



31 
8 

31 
9 
S 
4 
o 

88 



3 

13 
25 

IS 

12 
16 

7 

I 

88 



4 

8 

17 
8 

17 

13 

7 

3 

73 



5 

3 

9 

3 
II 

8 

9 

4 
47 



o 
6 
o 
2 

S 

9 
6 

28 



7 

O 

2 
O 

o 

i 

s 

2 
10 



o 

2 
O 
O 
O 
O 
O 
2 



Totals 

»S 
83 
89 

57 

57 
42 

16 
429 



TABLE II 



Per Cents of Students Assigning Different Positions to 

EaCH PhASE of THE WORK 



Phase of the Work 

Lectures 

Classroom Discussion 
Assigned Reading . 

Reports 

Essays and Theses . 
Laboratory Exerdses 
Comments, etc. . . 



37 
17 
36 
II 
16 
2 
o 



37 
10 

35 
16 

9 
10 

o 



3 

14 
30 

17 
21 

28 

17 
6 



9 

21 

9 
30 

23 
17 
19 



4 
II 

3 
19 
14 
21 

25 



o 

7 
o 

3 

9 

21 

27 



7 
O 

3 
o 

o 

2 
12 

13 



O 

o 

3 
o 

o 

o 

o 

o 
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TABLE 12 

Fer Cents op Diffesent Positions Assigneo to Diffesent 

Phases of THE Work 



Phase of the Work 1234 567 

Lectures 

Classroom Discussion 
Assigned Reading . 



Reports 

Essays and Theses . 
Laboratory Exerdses 
Comments, etc. . . 



33 35 14 II 6 o o o 

15 9 28 23 19 21 20 100 



34 35 17 II 6 o o o 

7 10 14 23 23 7 o o 

10 6 18 18 17 18 zo o 

I 5 8 10 19 32 so o 

o o z 4 9 21 20 o 



Since the relative values of the various phases of the 
work of the course difiEer not only for individual students, 
but also for individual instructors, an analysis of the dis- 
tribution of values assigned by students in Economics A 
is of particular interest. Here the important phases of the 
work are apparently lectures, class discussions, and reading. 
Since the lectures are the same for all, and the assigned 
readings are the same for all, interest centers particularly in 
the question of the relative value assigned to class discussion. 
Taking the group as a whole and considering only these three 
phases of the work we find that classroom discussion is 
assigned first, second, and third piaces m the proportion 
indicated in the table foUowing. By using this as a rough 
standard for the entire group we may compare with that 
standard the relative value assigned to class discussion (the 
sole variable factor) as it appears in the retums by students 
separated according to the instructor concemed. These 
distributions are indicated in Table 13. 
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TABLE 13 

Distribution op Class Discussion Assignments op Value (in Point 
OF Helppulness) by Students op Economics A (1914-1915) 

ACCOSDING TO THE InSTRUCTOR InvOLVED 





Numberof 


Per Cent of Students Assigning 


Positions 


Instructor 


Cases 


X 


3 


3 


AU 


322 


42 


39 


18 


Y 


31 


39 


48 


13 


X 


61 


49 


43 


8 


W 


54 


57 


37 


6 


V 


24 


25 


50 


25 


u 


44 


41 


41 


18 


T 


50 


28 


40 


32 


S 


23 


18 


64 


18 



From this table it would appear that it is quite possible 
that instructors W and X are highly efficient in the conduct 
of classroom discussion, that instructors U and Y have a 
fair degree of success, and instructors S, T, and V are rela- 
tively unsuccessful in the classroom discussion. However, 
since relatively small niunbers are involved, the table should 
be suggestive for self-examination rather than for dogmatic 
assertions conceming the relative efficiency of the classroom 
discussion as conducted by the various instructors. 

16. The problems met in lifey to which instruction in 
Economics was considered related, were stated in such 
general terms that the answers in this column have very little 
value, except to confirm the testimony on lack of practical 
applications. They are siramiarized below. Although the 
students are interested in very specific problems, in their 
statements conceming which they often show the influence 
of instruction they are receiving in courses in Economics, 
they interpreted the question conceming the relation be- 
tween instmction in Economics and problems of lif e in an 
entirely géheral fashion. 

1. General affirmative answers 89 

2. Negative answers 122 
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3. Spedfic he^ in vocation 6 

4. Indirect help in vocation 20 

5. Understanding of fundamental economic prindples 3 

6. Better general education and information 5 

7. Training in reasoning 9 

8. Gave broader outlook 14 

9. Gave political insight and information 32 

10 Better understanding of social problems 39 

11. Better understanding of economic problems other than social 56 

12. Better understanding and power to judge current affairs 4^ 

13. Better understanding of economic terms i 

14. Avoid current fallades 4 

15. Understanding banking and investment problems 16 

16. Helpful in accounting 3 

17. Helpful in accounting 2 

18. Cultural values x 

19. Purchasing of commodities 3 

20. Help in arranging Sunday School dass work x 



17. The mavements or problems of the day in which the 
students prof essed themselves interested were : 



Labor problems, unemployment, 
tråde unionism, capital and la- 
bor, etc 61 

Sodalism 53 

Tariff, protection, free tråde ... 32 

Peace, disarmament 24 

Woman suffrage, feminism ... 22 
Problems of banking, finance, and 

currency 18 

Prohibition 17 

Immigration, race problems ... 17 

Rural and agricultural problems 17 

South American tråde 16 

The war, and its social and eco- 
nomic effects 15 

Problems of business organization, 

development, and regulation . . 14 

Educational problems 14 

Single taz 14 

Problems of govemment and 

politics 14 

Munidpal administration, dty 

planning 13 

Taxation 13 



Social reform in general 12 

Public ownership and regulation 12 

Preparedness 11 

Public health, sanitation, housing 10 
International tråde, law, and rela- 
tions 8 

Trust legislation 7 

Railroad problems 7 

Religions problems 6 

Conservation 6 

Distribution of wealth 5 

Industrial development and effi- 

dency 5 

Eugenics, sex problems 5 

Codperative enterprises 5 

Land values and land titles ... 5 

Penology and prisons 5 

The negro problem 4 

Child labor 2 

Pure food 2 

Charities sndphilanthropy. ... 2 

Juvenile courts 2 

None 7 

Many, aU, in general 29 
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1 8. Suggestions and criticisms may be summarized as 
foUows: 



9 

ilt 



Sections and Assistants ^ 

1. Poor personality and poor teaching ability 3 

2. Hold aloof. Do not appredate students' 

point of view 3 

3. Hair-spHtting distinctions and tedmical 

phraseology z 

4. Impossible to get clear outlines or weU- 

defined ideas z 

5. Fewer sections and more lectures .... 5 

6. Fewer lectures and more sections .... 11 

7. Sections too large 6 

8. Double A section undesirable 3 

9. No instruction on "how to study". ... 2 

10. Too much emphasis on the text 4 

11. Time not properly allotted 2 

12. Discussion iU directed. No limit on talk- 

ative members 3 

13. Written questions not discussed in dass . 2 

14. Reasons for failure not explained .... z 

Lectures 

15. Too theoretical 13 

16. Better lectures desirable 5 

17. Lectures foUow book too dosely .... 24 

18. Object to textbook 3 

19. Wish views of other economists 6 

20. Suggest speakers outside department . . 4 

21. Lectures not correlated with reading (See 

also 42 below) z 

22. Lectures and discussions do not darify 

reading , 3 

23. Too much superfluous matter 4 

24. More time on first chapters of book ... 3 

25. More careful choice of topics 2 

26. Too many qualifying expressions .... 2 

27. Treat protection and free tråde together . 2 

28. Hard to hear the lecture 6 

Examinations and Tests 

29. More just and uniform marking sjrstem . 6 

30. General review to precede examination 4 



11 



Må 



II 

II 



17 



3 

4 

3 
2 



2 
4 

4 
4 



24 

I 
2 

4 

I 



3 

I 



z 
2 

2 
z 



21 



4 

9 

14 

8 

3 

3 
6 

6 

7 
6 

I 



40 

7 
26 

3 

Z2 

5 



4 

z 



4 
6 

3 
6 

3 

2 

6 



13 
5 
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|< 
ah 

li 

Examinations and Tests ^^ 

31. Too much emphasis on tedmical terms 3 

32. Questions on historical rather than eco- 

nomic view 2 

33. Too little time on tests 5 

34. Too much weight on mid-years and finals i 

35. More numerous papers, tests, and reports 5 

36. Tests too easy i 

37. Questions asked for too much detail, lay 

too much stress on memory and offer 

no choice 3 

Theses 

(See also 54, 55, 56 below) 

38. Requirements burdensome z 

39. More theses should be required 3 

Reading 

40. Assign more outside reading 5 

41. Reading requirements burdensome ... 2 

42. Reading poorly correlated with lectures . 7 

43. Allow more general and require less spedfic 

reading 3 

44. Critidsm of individuals i 

General Suggestions 

45. More printed questions 5 

46. Catalogue gives wrong impression .... 3 

47. Abolish oral examinations 2 

48. More contact, advice and help from pro- 

fessors 5 

49. More discussions and debates 14 

50. Open Economics A to f reshmen 2 

51. Discuss current periodicals in dass ... — 

52. No material for thesis assigned — 

53. Theses should be more carefully supervised — 

54. Thesis subject too remote from the general 

topic — 

55. Economics Department suggest groiq>s of 

studies in Economics for certain pro- 
fessions — 

56. Standaidized prindples ezpounded in 

sections — 
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Favorable comments are frequent, as the following 
excerpts show. Favorable comments on individual instruc- 
tors are often enthusiastic. 

Students taking Economics A only. 

Economics A. Twenty-six men speak favorably of this coiirse 
and those who give it. The followmg are some of the comments: 
"Well nm"; "admirably conducted"; "very good indeed"; 
"mechanically perfect"; "course is intelligently and efficiently 
håndled"; "best run of all the large courses"; "the most eflS- 
ciently conducted of any of the courses I have taken"; "tech- 
nically above reproach." One man is so pleased with the course 
that he declares "it should be made compulsory." 

Students taking Advanced Courses and Gradtiate Students. 

Twenty men speak very favorably of the courses they have 
taken. 

Economics A. "Well conducted"; "the most nearly perfect 
course in college — the theories can be grasped and bluffing doesn't 
count"; "I have nothing but praise for Economics A; the class 
discussions are particularly stimulating"; "sensibly conducted"; 
"of great value"; "the honor section is fine." 

Other courses, "Economics 3 is well conducted"; "Economics 9 
is extremely stimulating"; "Economics 5 and Economics 6 are 
well conducted"; "Economics 11 is one of the best courses I ever 
took"; "Economics 11 is the best course on accoimt of the train- 
ing in reasoning." 

Comntent on the Department in General. "Well satisfied with 
the Economics Department"; "courses are conducted in a very 
eflScient, sensible way"; "the Economics Department seems the 
best conducted of any department." 

These suggestions and criticisms are often put with a 
force to which the smnmary given above cannot quite do 
justice. The following smnmary taken directly from the 
replies is therefore added. 
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Section Meetings and Assistants 

More criticisms are made by students on this subject than 
on any other single point. Much stronger feeling is evi- 
denced by advanced and graduate students than by those 
taking Economics A only. Twenty-nine men from the first 
group and ten from the second (39 in all) make specific and 
severe accusations against the personality and teaching 
ability of assistants. They state that these instructors 
appear to have been chosen for high marks in Economics 
courses and not for their fitness as teachers, that they hold 
themselves too much aloof from the students and do not 
try to appreciate the student point of view, that they are 
unfair in their judgments and f ail to be helpf ul in presenting 
the work or in stimulating discussion, and that they tend 
toward hair splitting distinctions and technical phraseology. 
Graduate students are particularly opposed to the type of 
assistant often chosen. 

Fourteen replies mention various ways in which the section 
meetings are not systematically conducted. They refer to 
the lack of specific planning of the work and say that it is 
impossible to get clear outlines or well defined ideas from 
the instruction given. 

Ten advanced and graduate students think that dis- 
cussions are frequently too "fine spirn," are not properly 
directed, do not hold the attention of the class, are vague, 
technical, and do not clarify the questions raised. 

The suggestion is made by four men that some means 
should be taken to standardize the principles expoimded in 
the sections. They cite instances where the instructors 
have differed with professors on important issues and have 
thus confused the classes by injecting their own opinions. 

Five men believe that there should be fewer sections and 
more lectures, but there are on the other hånd thirteen replies 
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which consider the lectures of Economics A a waste of time 
and demand more section meetings. 

Eight men object to the size of the sections and think 
that better discussions could be had in smaller groups. 

Two men mention the AA section as especially imdesirable 
and think that it should be abolished. 

The foUowing criticisms of methods in section meetings 
seem to be worth cbnsidering. 

1. There are no lectures on how to study and little instruc- 
tion in methods of coUecting material, using library facili- 
ties, etc. 

2. The sections emphasize the text to the exclusion of 
other important matters. 

3. Too much authority is given to assistants in assigning 
readmg, resultmg in irregular assignments. 

4. Where laboratory sections are required, the amount 
of outside reading is not decreased and the requirements are 
burdensome. 

5. There is not always time to finish the problems assigned 
durmg the laboratoiy period. 

6. The laboratory assistants are careless in checking up 
the work of the students. 

7. Proper time allotment in the sections is often seriously 
neglected. 

8. Discussions are not well directed, do not include enough 
students, and no limit is placed on talkative members. 

9. The subject is not developed in new forms and interest 
is not aroused. 

10. Too many puzzling questions are asked and textbook 
answers are expected. 

11. Written questions are not discussed in class. 

12. No definite explanations are given of the reasonsfor 
f ailure so that the student can avoid futxure blimders of a 
sinular sort. 
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13. There is no uniform standard of reqnirements. The 
suggestion is made that the professors take sections in tum, 
thus giving the students a share of their time. 



Lectures 

The practical application of the courses is a matter which 
probably touches all the teaching in the Department, but 
seems especially important in connection with lectures, 
since the attitude taken by the professors in their lectures 
largely determines the trend of discussions and the character 
of written work. Thirty students in Economics A and 
thirty-three advanced and graduate students (sixty-three 
in all) believe that the courses are too theoretical, lack in 
concrete illustrations, and are not sufl&ciently applied to 
current, social, political, and financial problems. 

Twenty-six men in Economics A object to having the 
lectures follow the textbook so closely. A considerable 
nimiber of these object to the book itself. Sixteen men 
would like to have the views of other economists presented 
in Economics A. Many wish that speakers from other 
departments or from the business world might be heard. 

The following seem to be the most important suggestions 
conceming the conduct of lectures. 

1 . Correlation between reading and lectures is not always 
apparent. Lectures and discussions do not clarify or 
properly criticize the required reading. 13 repUes. 

2. There is too much superfluous matter in Economics A 
and the course is confusing because of the large amoimt of 
material and the detail accompanying it. 6 repUes. 

3. More time ought to be spent on the first chapters of 
the book. The work of the first few weeks is theoretical 
and leaves a confused impression. 3 replies. 

4. More careful choice should be made of the parts to be 
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treated in the lectures. Only the more diflBLCult portions 
need to be discussed. 2 replies. 

5. There are too many qualif)dng and limiting expressions. 
Students are confused by them. 3 replies. 

6. No outline or summary is provided. Statistical 
matter is not put on the blackboards or distributed on 
mimeographed sheets. 6 repUes. 

7. Protection should be taken up simultaneously with 
free tråde so that the two may be contrasted and compared. 
Let students choose for themselves on such questions. 

8. The lecture cannot always be heard distinctly. 3 
replies. 

9. Lectures cannot be heard in the rear of the gallery. 

3 replies. 

Examinations and Written Tests 

1. A more uniform and just system of marking is needed. 
10 replies. 

2. A general review preceding examinations would be 
helpful. 

3. The method of grading graduate students leads to 
cramming and decreased real productive work and clear 
thinking. 

4. Assistants expect students to use a certain phraseology 
in their answers which induces mimicry and discounts 
independent expression. Too much emphasis is placed upon 
technical terms used nowhere save in Economics courses. 

4 replies. 

5. Questions are asked from the historical rather than the 
economic viewpoint. 2 replies. 

6. Too little time is given for the short tests. They are 
an imfair basis for judging ability. Foreigners especially 
find great difficulty in getting anything written on questions 
proposed. 6 replies. 
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7. Too much stress is laid upon mid-yeax and final 
examinations. 4 replies. 

8. There ought to be more nmnerous papers, tests, and 
weekly reports. 8 replies from Economics A. 

9. Questions ask for minute detail, lay too much stress on 

memory, and there is no choice of questions. 5 replies, 

Economics A. 

Theses 

1. Thesis work is overdone and the requirements ara 
burdensome. 19 replies. 

2. Thesis was assigned on which no material was available. 
3 replies. 

3. More help and advice ought to be given on the first 
thesis. All theses should be more carefully supervised. 
Professors are disappointing in the interest shown in gradu- 
ate students. 4 replies. 

4. Theses and reading requirements overlap. 

5. The assigned subject was too remote from the general 
topic. 

6. Theses in the different courses ought to be coordinated. 

Reading 

1 . Assignments are irregular so that students cannot plan 
their work well. 

2. More outside reading should be assigned in Economics 
A. 7 replies. 

3. The requirements are burdensome in some courses. 

4. Reading is not well correlated with lectures and dis- 
cussions. 12 replies. 

5. Allow more general and require less specific reading. 

General Suggestions 

I. The printed questions are very helpful. There ought 
to be more of them. 3 replies. 
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2. The catalogue gives the wrong impression in regard 
to Economics courses. Students are led to believe that they 
are practical courses. 

3. Ventilation is poor in some rooms. Massachusetts 
Hall is a very unpleasant place in which to work. 

4. Current periodicals should be read and discussed in 
class. 

5. Oral examinations ought to be abolished. 2 replies. 

6. More advice and help from the professors is needed. 
More personal contact ought to be secured through con- 
ferences. 16 replies. 

7. There ought to be more emphasis upon discussions and 
debates. 29 replies. 

8. Open Economics A to Freshmen and give a course 
especiaUy suited to them so that men can decide earlier 
where they wish to concentrate. 

III. General Discussion 

The outstanding faet about both these sets of replies is 
their variety. The accomplishment of the alumni, taken as 
a body, and the seriousness and directness both of the alumni 
and of the students, as also the definiteness of their views, 
would give one respect for a concensus of their opinions; 
but it is hard to find any real concensus of opinion in their 
answers. One must be content to note tendencies, and to 
take individual suggestions for what they may be worth. 
This is probably the common experience with replies from 
questionnaires. 

About half (58 per cent) of the graduates are in Business 
or the Law; about half (54 per cent) of the students intend 
to go into Business or the Law. Of the graduate group in 
Law and Business 35 per cent foimd their instruction in 
Economics actuaUy helpful; of the imdergraduate group 



I70 THE TEACBING OF ECONOMICS 

intending to enter these occupations 22 per cent expect to 
find their instruction in Economics directly helpful. Educa- 
tors, journalists, ministers, and farmers find the courses 
vocationally valuable quite as of ten as do business men and 
lawyers; and the graduates as a whole find their work in 
Economics quite as valuable for "general culture" as they 
do in their vocations. The proportion who note specific 
social and cultural values is surprisingly smaU. On the 
whole, the expectations of the students are not unwarranted 
by the experience of their elders. The coimt on values 
shows, however, how difficult it is to differentiate one value 
from another — or how imused men are to the attempt. 
Perhaps it shows also the lack of definite objectives in the 
instruction and of full information on the part of students 
conceming their teachers' aims. It is a striking faet that 
the replies conceming specific reasons for choosing par- 
ticular courses could not be distinguished from those con- 
ceming the choice of Economics as a field of college work. 
This faet is not imrelated, moreover, to the faet that these 
students foimd it impossible to make dear the connection 
between their courses and specific problems met in life. 

The evidence as to the values of instruction in Econom- 
ics thus shows no very exact conception of the bearing of 
the subject on the activities of men. Twenty per cent of 
the alimmi make definite confession of their inability to 
discover tangible results from their study of Economics or 
to give concrete examples of its value. The preponder- 
ance of testimony to the eflFect that Economics had proved 
of value in "other, more general phases of life," rather than 
in vocations or in "social, civic, or economic activities out- 
side vocation'^ — (vocational values foimd by 42 per cent 
of alimmi, social-civic values by 26 per cent, general values 
by 64 per cent) — implies the same vagueness. This em- 
phasis on "general" values runs through all the vocational 
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groups: of the lawyers, for example, 54 per cent make no 
comment on vocational values, and 67 per cent make no 
comment on social-civic values; whereas 70 per cent find 
general values. Fourteen per cent of the lawyers confess 
confusion of mind as to values. A simflar showing appears 
from the testunony of the manuf acturers : 44 per cent make 
no comment on vocational values, 83 per cent make no 
comment on social-civic values; whereas 67 per cent find 
general values. The tendency to credit the study of Eco- 
nomics with a " disciplmary " effect on the mind may weU 
be another evidence of inability to discover specific appli- 
cations. Sixteen per cent of the lawyers mention general 
discipline and many of the alimmi, of all groups, use phrases 
impl)dng belief in it. Although one who sees quite clearly 
the connection of instruction in Economics with definite 
objectives in the careers and interests of men may neverthe- 
less see also a general effect of such instruction in widening 
mental perspective and fixing habits and ideals of intellec- 
tual thoroughness, still the imqualified ascription of "disci- 
pline" to instruction in any subject is not imlikely to mean 
that the student is imable or imwilling to discover just what 
use he has made of the facts, the principles, the ideals, the 
points of view, or the methods he acquired from his study. 
At any rate, there can be no reasonable question of the faet 
that the alumni are imcertain as to the direct applications 
of what they secured from their courses in Economics, 
whether they accoimt it knowledge, insight, power, or what- 
ever else. 

Surely these facts afford a safe basis for effort to define 
more clearly the aims of college instruction in Economics. 
A sharper differentiation of objective between course and 
course can but render each course the more effective for its 
special purpose. This is as true of general courses as of 
others — and it is to be noted that there is some demand 



172 THE TEACHING OF ECONOMICS 

for general courses even at the expense of the more special- 
ized courses. If both teacher and pupil understand that a 
given course aims solely at general intelligence conceming 
economic facts and forces and that the course involves 
neither practical training nor the full discussion of special 
economic problems, there can be no disappointment or con- 
fusion if the course does not result in the development of 
special abilities or settled opinions on particular issues. 
But ought there not to be certain courses which do secure 
these results? Or, as it is more important still to ask, if 
courses are already given which seem dearly to f avor prac- 
tical and definite results, ought not these courses to be 
more openly set apart from the "cultural" and "distribu- 
tive" courses and combined into concentration Schedules 
for specific piuposes? The alumni testimony conceming 
courses the writers "wish they had taken" is eloquent on 
this point. They wish they had taken coxurses of a practical 
character and evidently regret that they were not advised 
to do so. Since their time, to be sure, the Department has 
made much progress in this matter. There is a group of 
courses annoimced imder the caption "Applied Econom- 
ics," and the departmental Schedules for concentration and 
the degree with distinction now distinguishes specialization 
in Applied Economics from specialization in Economic 
Theory or Economic History. But there is not enough 
emphasis on the aims to be achieved in such courses or such 
Schedules. The academic distinctions between graduate 
and undergraduate courses confuse the issue, and the de- 
scriptions of the courses do not suflSciently inform the 
student of the results he may expect. The present (191 7) 
offering of the Department is rich in special courses, but 
almost entirely lacking in any open statement as to their 
usefulness, either singly or in combination, for any possible 
purposes of the student. 
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All this is but to say that the replies to the questionnaires 
support the contentions of Chapter II, above, on Aims. In 
much of OUT coUege instruction we are ignoring the purposes 
and needs of the students in order to carry out theories 
which have never been openly discussed. We are insist- 
ing on academic distinctions involving issues never brought 
to the surface. The theory of formal discipline interplays 
in our work with the theory of general culture and the theory 
of special training, but we have no dearly defined scheme 
for achieving different values by definite means and in 
definite combinations of courses. 

The replies to the questionnaires give very strong support 
to the condusion that the instruction in Economics fails to 
bring the student into close enough contact with economic 
data outside of books. Probably this criticism applies more 
to the past than to the present, and it may be voiced less 
often by the "brilliant" student (who most readily fills 
words with content) than by his less theoretically-minded 
feUows. But among students as among alumni, the most 
frequent criticism is that courses are "too theoretical" or 
"lack practical application." The root of the objection to 
yoimg section men lies quite as much in the faet that they 
do not "know the world" as it does in the faet that they 
are interested primarily in their graduate studies. The 
whole trend of the suggestions and criticisms is in f avor of a 
doser connection between study and "life." The change 
desired is a change of emphasis, a change in the choice of 
illustrative materials and problems, and a change in modes 
of presentation. It is as desirable in general courses as in 
others and might be brought about without adopting any 
settled poUcy as to practical training. 

The retums conceming advice on the selection of courses 
help to confirm the condusion that the purposes of students 
are too often ignored. Only a little over half of the students 
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replied on this point, and of these one-third took courses on 
their reputation, one-sixth on information from the cata- 
logue. Only a third of these students chose courses on ad- 
vice or information from members of the Faculty. 

Taken as a whole these retums from the questionnaires 
are convincing as to the need for an adjustment of college 
instruction to the aims and desires of our college popula- 
tion. We suffer still from the tradition that a college edu- 
cation is a preparation solely for a life of cultured leisure or 
else exdusively for the leamed professions. It would be 
imfortunate indeed if we were to break with the past too 
abruptly or give up the aims and methods which have stood 
the test of time. But if we are to maintain the American 
college as an institution wherein fully half the students are 
to become business men, scientific workers, govemment 
officials, farmers, and the like, our views of college instruction 
cannot remain as simple and imcritical as they still are. We 
need not ignore the general piupose to help every college 
student to be an intelligent himian being and a good citizen; 
indeed we must emphasize that piupose : but we can no longer 
defend imduly academic teaching nor pressure toward " schol- 
arship" as such, on the groimd that it is "good" for every 
student. We cannot treat students abstractly as "individ- 
uals." What they intend to do in life must have some 
weight with us when we advise them and when we frame the 
courses and Schedules they are to pursue. We must build 
up a more complete and organic aim for college teaching, 
based on fuller knowledge of our pupils and the uses of our 
instruction. 

In spite of the faet that there is a wide scattering of 
opinion in the replies to these questionnaires, a careful study 
of the retums shows how heavily they are weighted with the 
desire for instruction which shall challenge the student to 
greater interest, effort, and response. It is the artificiality 



QUESTIONNAIRES 1 75 

and remoteness of college work with which there is most dis- 
content. Because students want the subject to be brought 
home to them, they call for closer contact with professors, 
for more experienced assistants, for lectures by business men, 
for more frequent reference to current events, and for most 
of the rest of the great variety of things they consider desira- 
ble. Through all the lists and tables of this chapter, there 
runs a note of appeal for the closer adaptation of college work 
to the needs and purposes of the individual student. 



CHAPTER VI 

METHOD 

I. The Place of Method in College Teaching 

There are no universal criteria of correct method in teach- 
ing, for teaching has no single character which can be so 
analyzed as to yield a fixed "form" or a set of technical 
rules applicable to every lesson or exercise. Principles of 
teaching are like principles of conduct or of style: they 
are statements conceming the nature of means and ends and 
of the adaptation of one to the other in the whole course of 
the teacher's work. Teaching, to be sure, must be judged 
at every point by its effects on the student; no method can 
be def ended merely because it suits a purpose of the teacher 
other than the purpose to promote the process of leaming 
in his pupils : but the process of leaming, liberaUy considered, 
has so many parts and aspects and is so variously conditioned 
by the differing aims of the different subjects, by the differing 
circumstances of different schools, classes, and periods, and 
by the differing capacities of individuals and groups, that 
the method of a given exercise can be judged only in its 
relation to the total activity of which it forms a part. It is 
one contact among many between the mind of the instructor 
and the minds of his pupils. If it is weU conceived and 
properly carried out, it forwards in some appreciable degree 
and in some particular way the student's progress in the 
subject. Only in the light, therefore, of an intimate and 
comprehensive knowledge of the complete plan of a course 

— the whole complex interchange between instructor and 

Z76 
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students — can the method of a class hour be justly 
viewed. 

For these reasons this chapter must be impersonal and 
without specific application. It can only set forth in general 
terms the problems of method in college teaching as this 
Inspection has presented them anew and from a diflferent 
angle to the members of the Division of Education. It 
must accordingly risk the charge of being purely theoretical : 
but it is not in faet the expression of a theory ; rather it is an 
objective description and discussion of the factors in a 
general problem as they have been strikingly impressed on 
our minds by our visits to classes in the various Economics 
courses, by the examination of class papers, outlines, and 
reading lists, by the comments of graduates occasionally 
consulted, by the careful analysis of examinations, by 
systematic reports on the study-habits of certain imder- 
graduates, and by the retums to the questionnaires. We 
found it impossible to investigate single courses so fully as 
to feel justified in offering personal reactions on the methods 
of individual instructors; and we should have hesitated 
in any case to do so because of our lack of systematic 
knowledge of the subjects taught. In spite of the cordial 
invitation of the Department and of individual instructors 
to visit fully and to make our suggestions direct and personal, 
we can in consequence present only impersonal impressions 
and general conclusions. 

It must be admitted that a treatment of this sort wiU 
have practical value only according to the extent and serious- 
ness of the critical attention it causes to be focused on the 
factors of instruction most in need of it. What these factors 
are, in all its courses or in any, the Department of Economics 
can itself best determine. The Department can also best 
determine how to secure for these factors a new or an added 
emphasis. As we now see the problem, the submission for 
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departmental consideration of complete plans for courses, 
and visits by departmental cominittees, with frank dis- 
cussion of the resulting impressions, suggest themselves as 
the best means for inducing wholesome experimentation in 
method; but it goes without sa)dng that sucli action can be 
useful only when it is imforced, welcome to the instructor 
by reason of a genuine interest in its ends, and productive of 
no hasty effort to adopt methods or devices not fully incor- 
porated in the whole scheme of the instructor's teaching. 
Permanent improvement in method must be based, we 
believe, on careful experiment with selected factors in 
teaching, seen in their relation to other factors; and this 
view we have tried to embody in the foUowing discussion of 
our data in this field. 

To secure these data we visited 25 classes, including 
20 lectures or general class-meetings, and 5 section-meetings. 
Reports of these visits were filed at once, and later con- 
sidered as a group and in connection with the data from the 
questionnaires and the other sources. The visits were made, 
for the most part, during the academic year 1914-15, 
especially in November and December, 1914, and January, 
191 5; also in the early weeks of May, 1914. They brought 
us into contact with the work of nearly all the imdergraduate 
courses then in operation, specifically, Economics A, 1% 2», 
3, s, 6% 8, 14, and 31. The visitor in each case had in hånd 
the statement of aims submitted by the instructor in the 
course. 

A grouping of the points mentioned in the comments on 
the visits and in certain retums from the questionnaires and 
from the other studies provides the headings listed below, 
each of which covers a part or aspect of the problem of 
coUege teaching, simply as teaching, although such headings 
also suggest, of course, problems of aim, of the organization 
of curricula, of administration, and of marking. The head- 
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ings are neither exhaustive nor mutually exclusive. The 
list is made up strictly from the data of this Inspection. 
Although the replies to the questionnaires are by agreement 
to be retained in confidence by the Division of Education, 
and the comments on the visits were also confidential, the 
summaries of the questionnaires, given in Chapter V may 
readily be compared with the list. Probably the list includes 
about aU the chief factors in effective coUege instruction, 
and it includes many which are dearly recognized and 
admirably used in some or all of the courses we visited; 
but it doubtless misses altogether many factors of critical 
importance in particular courses. In no single exercise, 
perhaps in no single course, can all the factors listed be f ully 
utilized. If the list and the discussion present adequately 
the various factors, each in its relation to the others, both 
those here considered and those that wiQ occur to the 
readers of the report, this chapter wiQ meet such expectations 
of its value as we could reasonably entertain. 

Note. A statement of our general unpressions from the visits 
may be of interest, despite the faet that it can have only the value of 
a rough concenéus of personal judgments. The reports show that the 
instruction in Economics, viewed as a whole, and so far as it went, 
impressed us as excellent. The lectures, with few exceptions, we foimd 
dear, well-organized, stimulating, and forceful. Although in one or 
two instances they seemed to lack vitality and to win only a per- 
fimctory attention from the students, in several cases they were as 
admirable for the power to arouse and hold the interest of the class, 
as for other good qualities. The sections we visited were noticeably 
less effective, in general, than the regular dass meetings. In no case 
did the visitor consider the section work wholly imsuccessful, but in 
some of the sections the youth and the personal qualities of the as- 
sistants made the meetings far less profitable than they should have 
been. 

It may also be worth while to mention here what seem to us to be 
the most promising directions for effort in the improvement of the 
imdergraduate instruction given by the Department. These are: 
first, the abandonment, so far as may be possible, of sections, and in 
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courses where sections must be maintained, such measures as inay be 
needed to secure assistants of greater maturity, fuller scholarship, 
and better training for their work; second, the adoption of methods 
for establishing closer contact between teachers and students (of 
which the Tutorial scheme now in operation is one) and espedally for 
securing more frequent and more profitable reactions from the stu- 
dents, including fuller participation in class meetings; third, greater 
effort to devise and conduct with advantage, exercises which will 
bring the students into active contact with the problems of the sub- 
ject, in their practical form. These proposals are discussed somewhat 
more fully bdow. 

II. A List of Factors m College Teaching, 
EsPECiALLY m the Teaching of Economics 

A. Factors which affect the attitude of the student toward his 
work. 

(a) The stimulation of purpose in general and the definition 
of spedfic aims, by 

(i) Encouraging an imderstanding of the scope, object, 
and values of the course, by means of 

(a) Advice in the selection of the course 

(b) Printed statements about the course 

(c) Personal conference with students early in the 
course 

(d) Early discussion in dass of the character of 
the work required and of its values 

(2) Adapting the work, at least in part, to individual 
interests and needs, by means of 

(a) Permission to choose, within limits and imder 
guidance, the subjects of theses, spedal read- 
ing, and other independent work 

(b) Personal conf erences with students 

(c) Discussion and critidsm of tests and examina- 
tion books, in addition to the return of 
marks. 

(d) Personal guidance in thesis work, espedally in 
the case of students imaccustomed to it 

(e) Provision for supplementary and volimtary 
reading or other work beyond the requirements 
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(3) Relating the course to present problems of conduct 
or of thought, by means of 

(a) Discussion of these problems in class meetings, 
and frankness on the part of the instructor 
conceming his own point of view 

(6) Recognition of these problems in the choice of 
reading, thesis subjects, and other work 

(c) Lectures by persons other than the instructor 

{i) Credit in the course for participation in in- 
vestigations and other projects under govem- 
mental^ plulanthropic, or business auspices 

(«) Opportxmity to use data from observation and 
investigation of activities, as in business and 
govemment, as well as from books 

(J) The use of current literature as material for 
class discussions, reports, etc. 

(b) The maintenance of attention and interest during class 
meetings, by 

(i) Securing appropriate attention in advance to the 
topics to be considered during class meetings, by 
means of 

(a) Assignments of spedal reading to be done in 
advance, and such tests or records of it as may 
be necessary 

(i) Formulation of specific problems and questions 
to be considered in connection with tiie read- 
ing, or independently, and the requirement, at 
discretion, of written or oral reactions on them 

(c) Encouragement, or assignment as a task, of the 
discovery by students of particular problems 
under a general principle, or of new facts and 
applications involved; annoimcement in ad- 
vance of a date for discussion of these 

(2) Connecting class meetings definitely and explicitly 
with the other work of the course, by means of 

(a) Outlines and syllabi of the main divisions of the 
course, showing the connection of the lectures 
and class discussions with the general assigned 
reading and other independent work 

{b) Reports in class from individuals or groups on 
reading or investigation on the topic in hånd 
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(c) Use of required texts and other material in 
class as the basis of discussions or lectures 

(d) Carefiil corrdation of the lectures and the sec- 
tion meetings 

(e) Discussion in class of written papers and other 
assigned work 

(3) Making clear the pnipose of each class meeting 
and assuring a measure of progress toward it during 
the hour, by means of 

(a) Statements of purpose by the instructor and 
statements by students on question from the 
instructor 

(b) Outlines on the board or on sheets distributed 
to the class 

(c) Prevention of irrelevant discussion, question, 
and comment, and dismissal or postponement 
of problems not profitable to discuss — occa- 
sionally with assignments for reading or study 
to be done either by the class or by individuals 
or groups 

(d) Simmiaries of discussion, by the instructor or 
by the students 

(4) Providing appropriate opportimity during class 
hours for participation by the students, and mak- 
ing their participation profitable, by means of 

(a) Discussion, kept relevant and stimulated by 
comment and question from the instructor 

(b) "Socratic" development of the topic by ques- 
tion and answer 

(c) Quizzes, oral or written; brief papers in 
class 

(d) Encouragement of questions from the class 

(e) Records on the board of diverse opinions or 
points of view presented by students, and 
discussion or lecturing on the issue thus 
formulated 

(/) Extension of the discussion to the whole mem- 
bership of the class; direction of discussion to 
the class, not to the instructor 

(g) Encouragement for the presentation in clas 
of instances, examples, applications, and prob 
lems discovered or formulated by the students 
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(5) Using skillfully and advisedly the opportiinities of 
the instructor's position for personal influence, by 
means of 

(a) Good lecturing, and skillfiil leadership in dis- 
cussion 

(6) Frank expression of personal opinion and point 
of view on issues of importance in or connected 
with the subject of the course 

{c) Full and fair statement of contrary theories 
and points of view, in advance of critidsm or 
comment 

(J) Cordial recognition of divergent opinion on 
the part of students 

{e) The nse of concrete and familiar instances, ex- 
amples, and cases; the encouragement of stu- 
dents in discovery and citation of these 

(O Unsparing attention to the personal difficulties 
of individuals, outside of class meetings 

(g) Lectures by persons other than the instructor 

(c) The encouragement and direction of effort in study and 
in other work outside of class, by 

(i) Setting up reasonable standards of performance 
and maintaining them equitably, by means of 

(a) Careful calculation of the time required for 
reading, theses, and other work 

(i) Full statement of the requirements as to form 
in written work 

(c) Coordination of thesis requirements with 
those of other courses, and consultation with 
students and other instructors as to the 
best times for the submission of written 
work 

((/) Adequate direcdons for the use of sources, 
bibliographies, etc; care in arranging for prac- 
tical exercises; attention to library faciUties, 
laboratory arrangements, opportunities for 
fieldwork, etc. 

(e) Insistence on promptness in submitting work 

(J) Personal conf erence with students in the course 
of their work 

(g) Frequent use of tests, quizzes, brief papers, 
etc, with explicit statements, of the way in 
which these are to '^coimt" in the final mark 



1 84 THE TEACHING OF ECONOMICS 

(A) Spedfic references to reading, avoiding waste 
of time or neglect of work because of diffi- 
culty in discovering the application of assigned 
reading to the problem in band 

(2) Giving personal and adequate attention to the com- 
pleted work submitted by students, by means of 

(a) Full reading and personal coroment in the case 
of theses and other written productions 

(b) Personal conf erences on the results of investiga- 
tions and other practical exerdses 

{c) Care in grading 

B. Factors which favor effectiveness of effort in the work itself. 

(a) The general organization of the coiurse to prevent waste 
of time and distraction of effort, by 

(i) Codrdinating the various requirements of the course, 
by means of 

(a) Definite statements of the purposes in view, 
both for the coiurse as a whole, and for sepa- 
rate assignments and exerdses 

(b) Outlines of topics for class meetings, showing 
the connection between assigned readmg and 
the lectures and discussions. (See A, (b), 
(2), (a), above) 

(c) Careful correlation of the lectiures and the sec- 
tion meetings. (See A, (b), (2), ((O, above) 

(2) Defining exactly the work to be done (see A, (c), 
(i), above), by means of 

(a) Printed statements in an outline or syllabus of 
the course 

(6) Adequate directions for the use of soiurces, 
bibliographies, etc; care in arranging for prac- 
tical exerdses; attention to library facilities, 
laboratory arrangements, opportunities for 
fiddwork, etc. (See A, (c), (i), (rf), above) 

(c) The use of forms for retxun of information of a 
fixed character 

(3) Keeping dosdy in touch with the work of indi- 
vidual students, by means of 

(a) Reports on reading and other work 

(b) Personal conf erences 



METHOD i8s 

(4) Managing tests, quizzes, brief papers, and examina- 
tions so as to show students their progress and help 
them to understand the subject, by means of 
(a) Care in choosing questions and topics 
{b) Discussion of the results in class and in con- 
ferences 

(b) The management of class and section meetings to f avor 
eflFective leaming of various types, by 

(i) Assuring adequate and appropriate impressions 
when a set of figures, a graph, or other visual 
material is to be memorized, by means of 

(a) Distribution of printed sheets 

(6) Use of the blackboard 

{c) Use of colors, either on the board or on sheets 

(d) Use of the reflectoscope 

(e) Use of photographs 

(/) Insistance on accurate copying into notebooks 

of the material presented 
(g) Full explanation of the significance of the 

material 

(2) Assuring full assimilation of a definition, heading, 
quotation, or other exact statement to be memo- 
rized, either verbatim or in substance, by means of 

(a) Distribution of printed sheets 
(6) Use of the blackboard 
(c) Insistance on accurate copying in notebooks 
{d) Full exposition of the meaning 
(e) Discussion of cases, exceptions, opposites, etc. 
(/) Questions to test the students' grasp of the 
statement or their ability to apply it 

(3) Assuring complete imderstanding of a generaliza- 
tion, theory, point of view, interpretation, or other 
complex object of thought, by means of 

(a) Full exposition of the facts involved, prefer- 
ably before the generalization itself is presented 
— preceded or accompanied, if possible, by 
actual observation of facts and situations, in 
addition to or in place of presentation by lec- 
tures or reading 

(6) Careful definition of the problem which the 
facts present, pref erably by discussion — based 



1 86 THE TEACHING OF ECONOMICS 

if possibléy on paxticipation in work which in- 
volves the problem in practical form 

(c) Encouragement of attempts on the part of 
students to make the generalization for them- 
selves; discussion of students' generalizations, 
either in class or in conf erences 

(d) Discussion of cases, exceptions, applications, 
etc; quizzes, exerdses, practical assignments 

(4) Providing opportunities, incentives, and guidance 
for constructive thinking in class, by means of 

(a) Full statement of the facts to be considered — 
sometimes by the students, sometimes by the 
instructor; use of the blackboard to bring out 
clearly the facts or their significance 

(b) Definition of issues by discussion 

(c) Reports of reading or fieldwork, or statements 
of point of view by individuals and groups 

(d) Presentation of facts or convictions by "out- 
siders" 

(é) Discussion in class of theses, or of passages 

from texts 
(/) Discussion in class of required oral or written 

statements or argimients on unsettled problems 
(g) Careful avoidance of dogmatism on the part 

of the instructor, without hesitation in ex- 

pressing his own point of view 
(A) The discussion of principles in their actual ap- 

plication to cases and situations, either real or 

hypothetical 

(5) Using the lecture, discussion, quizz, recitation, 
and other modes of teaching with due regard to 
conditions, e. g., niunber in the class, their knowl- 
edge of the subject, etc, and to the character of 
the material to be considered, its difficulty, 
familiarity, the exactness with which it is to be 
recalled, etc. 

(6) Making the physical conditions of the dassroom as 
favorable as possible for attention 

(c) The direction of work outside of class to f avor eflFective 
eflFort, by 

(i) Encouraging good management in reading, thesis- 
work, etc, by means of 
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(a) Early and complete statement of requirements. 
(See A, (c), (i), (a) and (i), above) 

{b) Discussion of the character of the assignments 
and directions as to study and work. (See Å, (c) 
(i), (rf), above) 

(c) Personal conf erences 

((O Reports on reading, brief papers, outlines, 
quizzeSy and other tests and reactions; discus- 
sion of these in class and in conf erences 

(e) Advice on review for examinations; the inspec- 
tion of notebooks; discussion of habits of study 
and the organization of materials 

(2) Using all opportimities to bring students into actual 
contact with the facts and problems of the subject, 
by means of 

(a) Requirement of personal observation to sup- 
plement reading. (See A, (a), (3), {c), above) 

(6) Participation in the work of govemmental, 
philanthropic, and other agendes and institu- 
tions. (See A, (a), (3), (rf), above) 

(c) Investigations and other "projects" of an 
active sort 

{i) Reports by students of instances, exceptions, 
and applications in contemporary lif e 

(3) Encouraging constructive work and direct personal 
formulation of problems, by means of 

(a) Permission to choose, within limits and imder 
guidance, the subjects of theses, spedal read- 
ing, and other independent work. (See A, (a), 
(2), (a), above) 

(6) Personal conf erences 

{c) Reports by individuals and groups in class. 
(See A, (b), (2), (6), above) 

{i) Encouragement of supplementary and volun- 
tary reading and other independent work 

(4) Avoiding assignments for work outside of class 
which involve leaming most effectivdy accom- 
plished imder direction, by means of 

(a) Occasional use of class time for presentation of 
material for exact memorization. (See B, (b), 
(i), above) 
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(b) Occasional use of class time for memorization 
of verbal statements. (See B, (b), (2), above) 

(5) Åvoiding in class the presentation of material more 
economically studied outside of class, by means of 

(a) Use of printed sheets, doamients procurable 
by students, etc. 

(b) Assignment as a task of written analysis or 
application of principles or problems not 
adapted to class discussion or not suffidently 
important or difficult to warrant it 

III. General Discussion 

Such a list as this requires no explanation, for it presents 
no suggestion difl&cult to understand, however difl&cult 
some may be to carry out; but it may well raise issues on 
which there is room for difiference of opinion. The whole 
first section of the list — "A. — Factors which affect the 
attitude of the student toward his work" — may seem to 
imply the notion that college instructors ought to court 
interest and cosset enthusiasm as if undergraduates were all 
spoiled children, incapable of independent endeavor. The 
second section of the list — "B. — Factors which favor 
effectiveness of effort in the work itself " — may imply the 
notion that the student is to have his work so charted and 
guided for him that it will be all "plain sailing." Of course 
no such notions are intended, for the first section is meant 
merely to suggest ways in which the student's general will 
to work may be hamessed, directed, or given greater leverage 
or more specific application, and the second to suggest ways 
in which his effort may be made to yield the best results. 
The college student who has no interest in study and would 
rather shirk or hunt "snap" courses than apply himself , 
presents a disciplinary problem, not a problem of method. 
Method must be based on consideration of the normal case 
— the college student who has good intentions, who is 
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interested and ready to leam, who does the best he knows 
how. Toward him the college instructor has by no means 
discharged his whole obligation when he lectures as well as 
he can, assigns reading from the best treatises on the sub- 
ject, and provides a list of topics for theses. The methods 
of a primary school are hardly less appropriate in an Ameri- 
can college than the " laissez-f aire " methods of a German 
imiversity. To stimnlate purpose and define it, openly and 
without any attempt to interest the student "in spite of 
himself," or to supply conditions and directions for his work 
which shall make it possible for him to get a good return for 
his time and energy, need not mean the slightest lowering of 
standards. Indeed such efforts should make in every way 
for higher standards. 

A suggestion very frequently advanced in the answers to 
the questionnaires, and consequently prominent in the list, 
is that more opportunity be provided for personal contact 
between student and instructor. What students want and 
seem genuinely to need is not contact with assistants or 
younger instructors, but with the men actuaUy in charge 
of courses. The new system of Tutors will supply this need 
in part and for some men, but not as f ully as would increased 
opportunity for conference with professors; and this need 
presents a problem by no means simple. It is easy to agree 
that conferences are profitable; but they are very time- 
consuming. The problem is at bottom a problem of general 
college economy — the problem of the large course. The 
best solution, without question, is to have the whole work 
of a course done by one man; nothing can compensate to 
the student for the almost inevitable lack of imity between 
the professor and the assistant. It would seem an excellent 
investment of college funds to permit professors in many 
cases to dispense with assistants and reduce the number 
of their courses. Ought not the work of a college instructor, 
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as a teacher, to be reckoned in any case by students rather 
than by courses ? And would it be impossible to arrive by 
discussion, without elaborate inquiry, at a reasonable 
measure of the teaching burden one man ought to carry?^ 

There are good reasons, of course, why certain courses 
should be kept too large for a single man to give. In some 
cases it might be f easible to have identical courses given by 
two instructors, but this would introduce certain difl&culties 
due to imavoidable dififerences of ability and of point of view 
between the two. Where sections offer the best solution, 
as they undoubtedly do, for example, in Economics A, there 
seems to be no way of avoiding their disadvantages except 
by direct effort to secure the best possible assistants and 
to unify their work by the most careful management. The 
proposal that assistants receive some training for their work, 
including a practical apprenticeship under supervision, 
deserves careful consideration. The provision of effective 
training for prospective college teachers is surely not 
impossible and would be welcomed by many of them with 
genuine interest. 

Outlines and syllabi are mentioned as advantageous in 
several of the comments on the visits, and thus find appro- 
priate piaces in the list. Their advantages are perhaps 
less obvious than their dangers. In some courses, syllabi 
may be imdesirable because of the character of the subject. 
It is possible, also, to invite laziness by providing a syllabus 
which has much the character of a set of printed notes, and 
hence tempts students to undesirable "cramming." But 
a well devised syllabus will present topics rather than data 
and conclusions, and will serve rather as a map of the ground 
to be covered than as a means of getting over it without 

1 See Birge, E. A. " How Many Hours a Week Should be Required of Teachers 
in a University?" TransacUons and Proceedings of the NaUonal Association oj 
SUUe UniversiUeSj v. 14, 1916. 
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effort. A syllabus may contain statements of the purposes 
of the course and directions for theses, field work, and 
exercises which will prevent misunderstandings and be of 
much value in guiding the students' efforts; it should serve 
to luiify his impressions from the lectures and the reading; 
and by presenting specific assignments of reading in con- 
nection with each topic it may save time in class and in 
study. Its fimdamental advantage is that it makes it 
possible for everyone concemed, but especially for the 
student, to know at every point just where he is in the 
course, where he is going next, and why. 

One object of the questionnaires prominent in the minds 
of the joint committee which framed them was to discover 
to what extent instruction in Economics is missing the needs 
of individual students. What the questionnaires reveal on 
this point is presented in another chapter; but it must be 
plain to anyone who has had experience in college teaching 
that one of our difl&culties as instructors — a difl&culty not 
so pressing in any lower school — anses from the absence 
of continuous reaction from our students. We do not know 
what they are thinking about, whether or how they have 
grasped our meaning, what objections they might raise, 
what conclusions they are likely to come to. They have few 
opportunities for expression or for interchange of ideas with 
us or imder our guidance. This means educåtional waste in 
college classrooms; and this is the reason why participation 
in class exercises is so desirable, personal conferences often 
so illuminating, and the purely educåtional use of tests, 
quizzes, and written papers, with discussion of the results, 
so profitable. We frequently miss the individual simply 
because we do not know, psychologically speaking, where 
he is. When classes reach a certain size it is impossible to 
know individuals intimately at all, and the best we can do 
is to tempt revealing reactions on matters of importance; 
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but this disadvantage of the large class ought to be empha- 
sized on every possible occasion and we ought to counteract 
it in whatever ways we can. 

Other sections of the Report present records to show 
that students do not give to their several courses anything 
like equal attention or effort. In part this is unavoidable 
and even desirable; but in part it is probably due to uneven- 
ness in requirements and to lack of calculation of the time 
reading ought to take, or theses, or practical exercises. 
College work is necessarily distracting in itself, and the 
student is further distracted by college activities even when 
he gives them only a reasonable amount of time and energy. 
It is surely important that our requirements be justly cal- 
culated, definitely set forth, and accompanied by directions 
so plain and ample that students need not waste time in 
whoUy valueless efforts to find material which ought to be 
readily available. There is in this, of course, no disparage- 
ment of the value of an exercise involving the discovery by 
the student himself of new material or data adapted to his 
individual use but imfamiliar, it may be, even to the in- 
structor. 

In one respect college instruction seems to miss a fairly 
important opportunity to prevent waste of efifort — it 
seldom dififerentiates clearly between the types of leaming 
required of students. College instruction easUy becomes 
predominantly verbal — its conditions favor lecturing and 
assigned reading, make difficult the observation of facts 
and constructive reasoning from actual data, and tempt 
instructors to ignore the requirements of the simpler types 
of leaming, such as memorizing from sense impressions. 
Neglect to provide proper conditions for the memorization 
of visual material, or for verbatim leaming of definitions, 
is, however, easy to prevent. Leaming of either of these 
sorts may be conducted so that none but the lazy or def ective 
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can avoid a good result. But it is much harder, as it is 
much more important, to bring students into actual contact 
with the facts and problems of a subject, outside of books. 

In the social sciences college instruction seems peculiariy 
prone to lack of reality. This is in no sense a charge against 
Harvard coiu*ses in particular, for there are notable instances 
of provision in Harvard courses for contact with "outside 
activities"; but it is evident that this provision might be 
systematized and extended. Yet it is evident, also, that 
advance in this direction is beset with difficulties. It is 
easy to bring students into contact with sources in literature, 
and not impossible in history; laboratories and specimens 
bring the object of study actually before the student in the 
natural sciences: but it is possible to give a course, for 
example, in Labor problems, without bringing the students 
into any contact whatever with laborers, the labor-market, 
the conditions of specific Industries, or any other facts or 
situations with which the subject deals. It is not only 
possible to do so, but to attempt in such cases to bridge the 
gap between "study" and "hfe'' may seem decidedly 
dangerous. For in Economics, students can sometimes be 
given at best only a glimpse of the facts, and their impres- 
sions may be very misleading and imscientific. A proper 
variety of facts may, furthermore, be quite out of reach. 
There is a strong tendency therefore to avoid disaster by 
sticking to lectures, reading, and the study of documents. 

But if college instruction is really to induce men to think, 
lack of reaUty is a fatal defect in it. The most educative 
thing a man can do is to observe facts for himself, define 
an issue from them, argue it out with his fellows, and apply 
his conclusions in action or in further thinking. The process 
of finding a problem in the facts, and solving it, awakens 
interest and illuminates the subject; to be successful in it 
breeds confidence and suggests new lines of inquiry; the 
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conclnsions thus reax:hed become vital and permanent posses- 
sions and afiFect conduct directly and forcefnlly. The most 
pressing need in the method of college teaching in the 
social Sciences is therefore the need of devising "projects," 
"practical" exercises, and means of contact with the facts, 
institutions, conditions, and situations which the vartous 
courses treat. This need seems already to be recognized as 
imperative, as the appointment of Committees on Practical 
Training by the American Economic Association and the 
American Political Science Association and of a Committee 
on Field Work by the Association of Urban Universities 
would indicate;^ but committee inquiries are less productive 
and more likely to be led astray by visionary leadership 
than is quiet experiment in the courses of a single depart- 
ment. 

Practical training means in the present discussion simply 
a method of teaching, and may be used as such in a course 
which aims at an entirely "cultural" result, as, for example, 
a general imderstanding of the field of Economics as a whole. 
In a course which aims directly at preparation for vocational 
or other social activity, practical training would naturally 
be intensified and made continuous. The place and import- 
ance of such courses is discussed above, in the chapter on 
Aims. 

Practical training may of course be overdone, and field- 
work developed as a method without discrimination. De- 
vices and even so-called principles may become for the 
teacher as confining as tradition and a blindly accepted 
procedure. The only end in itself in education, as President 
Lowell has recently emphasized, is the student — but, it 
may be added, the student seen always in relation to the 
society into which his education is to fit him as a member. 

^ See also The Public Servante a journal published by the Sodety for the 
Promotion of Training for Public Service, Madison, Wis. 
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The only secret in teaching is the secret of keeping dearly 
before one's mind the object to be attained and adapting 
one's procedure to it; but the object is complex and the 
adaptation of necessity varied and often delicate. The 
Division of Education may well disdaim any abiUty to 
point out to the Department of Economics a new or better 
road to success than the road it is akeady f oUowing — the 
road of careful analysis of the problems of teaching and of 
continued attention to the details of teaching, as its chief 
duty with imdergraduate students. 



CHAPTER VII 

MARKING 

I. A Study of a Set of Marks Given in 

ECONOMICS A 

Through the conrtesy of Professors Taussig and Day a 
study of marking in Economics A was camed out during 
the spring of 1913. 

Ten mid-year books were selected and marked, after the 
usual careful discussion of standards, by seven instructors 
in the course. In each book there were ten answers, and 
each instructor gave a separate mark for each answer, as 
well as a mark for the book as a whole. The mark for the 
book was of course an aggregate of the ten marks for the 
answers. The resultmg series of marks (seven hundred in 
all) was examined from several points of view, with the 
foUowing results. 

The study considered two main problems, namely, (i) 
what questions of the ten making up the books caused the 
greatest diversity in marking, and why? (2) how greatly 
did the instructors vary in their estimatet of the books 
and questions, and incidentally, which instructors varied 
most from the central tendency? 

Problem I 

Which of the ten questions caused the greatest diversity of 

judgmentj and why ? 

Sheet A (p. 199) contains in detail two samples of the 

data which provided the numerical basis for a solution of 

196 
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this problem. In the case of each question we listed in the 
first column (headed Av.) the arithmetical mean of all the 
grades given to that question in each of the ten books. The 
figures given in the colimms headed A-G state the devia- 
tion of each marker from the average presented in the first 
colimm. The last colimm gives the average of these devia- 
tions for the separate books, and the bottom line the average 
deviations for the several markers. By taking the arith- 
metical mean of all the deviations on each question, it is 
evident that we could secure in one figure an index to the 
variation caused by that question. 

Sheet B (p. 2cx>) shows the questions arranged in order of 
this figure. It wiU be seen that Question 4 caused the least 
diversity and Question 3 caused the greatest diversity. 
In Question 4 the average diversity was less than one grade 
on a scale of ten; on Question 3, nearly a grade and a half. 
On a percentage scale, the diversity on Questidh 3, Book 
VIII (the book which caused the greatest diversity on that 
particular question) averaged 17 per cent; one marker gave 
the answer zero, another seventy; and only two markers 
gave it the same grade. On Question 4, Book II, all the 
markers agree : this is the only instance of perf eet agreement 
in the one himdred sets of marks. 

The questions were: 

1. Give examples of each of the foUowing: vertical combination; 
intemaleconomies; localization of industry ; increasing retums. 

2. In the case of a commodity produced under constant retums, 
does demand determine the price of the commodity or the 
quantity produced? lUustrate by diagram. 

Would your answer be the same if the commodity were pro- 
duced under diminishing retums? 

3. The cost of raising wheat on new land in Canada is said to be 
far bdow the average cost of raising wheat in the United 
States. Supposing this to be the case, can wheat grown in the 
United States continue to be sold in foreign coimtries in com- 
petition with Canadian wheat? 
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4. How woiild a great increase in the world's supply of gold 
affect: (i) The value of the gold dollar. (2) The value of the 
Silver dollar. (3) The price of silver bullion. (4) The price 
of gold bullion. 

5. State briefly what was the course of prices in the United States 
(a) between 1860 and 1870, (i) between 1900 and 1910. What 
were the canses of the price changes in each period; what evils 
arose; and how conld the evils have been avoided? 

6. Arrange the following items of a bank statement in their proper 
order: 

Loans $380,000 

Bonds 50,000 

Notes 50,000 

Capital 100,000 

Other Assets 40,000 

Siuplus 30,000 

Undivided Profits 10,000 

Real Estate 32,000 

Deposlts 350,000 

Due from banks zo,ooo 

Notes of other banks 3>ooo 

Cash 35i00o 

Conld this be the statement of a national bank, conducting 
its business in conformity to law? 

Suppose the bank to sell bonds which on this statement are 
carried as worth $50,000; selling them at a profit of $1,000, 
and receiving cash for them. Rearrange the statement, and 
consider whether it conld then be the statement of a national 
bank conducting its business in conformity to law. 

7. How would a great increase in the production of gold in the 
United States affect: 

The imports and exports of the United States; 
The "balance of Tråde" of the United States; 
The price of foreign exchange in New York? 

8. Suppose large remittances to be made by immigrants from the 
United States to their native coimtries: what consequences 
would you expect on (i) the stock of specie circulating in the 
United States; (2) the relation between merchandise exports 
and imports; (3) the gain which the people of the United States 
secure from foreign tråde ? 
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9. Which of the foUowing would you reckon as part of the wealth 
of the coiintry? as part of its capital? 
The Great Lakes, 
The Panama Canal, 
Deposits in banks. 

10. Is the establishment of a manufacturing industry, brought 

into eadstence by a protective tariff , advantageous in that it 
creates a home market for agricultural products? 

SHEET A 

Problem I. Ai^o Problem n, Section z 

The relation of the questions to one another in respect to the degree of varia- 
bility which they cause m the marks assigned to them 

QuEsnoN I 

Book Av. A B CD EF G Av. D. 

I 8.7 1.3 1.7 1.3 0.7 0.7 0.3 0.3 0.9 

n 8.3 0.3 0.3 0.7 0.7 1.3 0.7 0.3 0.6 

in ...... . 8.7 0.3 0.3 1.7 0.3 0.3 1.3 0.7 0.7 

rv 8.1 1. 1 1. 1 0.9 0.9 1. 1 1.9 0.9 1. 1 

V 9.0 1.0 2.0 0.0 i.o 0.0 1.0 2.0 i.o 

VI 7.3 0.3 0.7 0.3 1.3 0.3 1.7 0.3 0.7 

VII 7.7 1.3 0.3 1.7 1.7 0.3 1.3 0.3 1.0 

VIII 6.4 1.6 0.6 2.4 0.4 0.6 0.6 0.4 1.0 

IX 6.7 1.3 0.3 0.7 0.3 0.7 0.3 0.7 0.6 

X 8.4 0.6 0.6 0.6 0.4 1.4 0.6 0.4 0.7 

Av 7.1 0.9 0.8 I.o 0.8 0.7 1.0 0.6 0.8 

Av. Dev. = .82 

QUESTION 4 

Book Av. A B C D E F G Av. D. 

I 9.0 1.0 I.o I.O 0.0 0.0 2.0 1.0 0.9 

n 7.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 

III 6.9 o.i o.i o.i o.i 0.9 o.i o.i 0.2 

IV 1.6 1.6 0.6 2.4 0.6 1.6 1.4 0.4 1.2 

V 8.9 1. 1 1.9 O.I 1. 1 0.9 O.I O.I 0.8 

VI 8.1 1.9 1. 1 0.9 1.9 1. 1 1. 1 1. 1 1.3 

VII 6.9 1. 1 0.9 O.I 0.9 O.I O.I O.I 0.5 

Vin 5.1 O.I 1.9 3.1 O.I O.I O.I 1.9 1.0 

IX 7.4 0.6 0.4 0.4 0.4 0.4 1.6 0.4 0.6 

X 9.7 0.3 0,7 0.3 0.3 0.3 0.3 0.7 0.4 

Av 7.0 0.8 0.8 0.8 0.5 0.5 0.7 0.6 0.7 

Av. Dev. = .70 
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Chart I (below) presents the facts under the first problem 
in graphic form. A glance will show that the markers are 
in f airly close agreement on Question 4, whereas on Question 
3 they spread out horizontally on ahnost every book. 

This Chart suggests also at least one reason for diversity 
in the marking of certain questions. 

It will be noted that the uniformity of marking on Ques- 
tions 4, 6, and I is a uniformity mainly in the giving of high 
marks. That is, these questions were favorable to agree- 
ment because the students foimd them relatively easy to 
answer. On the other hånd, the diversity on Questions 
10 and 3 is a diversity caused mainly by disagreement as to 
relatively low marks — an observation which is further 
suggested by the faet that the average mark on each of these 
questions (5.5) is lower than any other. This contrast would 
indicate that "hard" questions caused greater diversity of 
judgment than "easy" ones. 

Other facts bear out this conclusion. Examining the 
chart, we may note, first, that only in one case was there 
marked diversity instead of uniformity of judgment on 
Question 4 — in the case, namely, of Book IV. FoUowing 
the record of Book IV across the Chart, we discover that 
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the student who wrote this Book was generally a poor 
student: his grades fall low on most of the questions. We 
discover also that on almost every question he caused much 
variation in marking. Furthermore, the Chart shows a 
great preponderance, in general, of agreement in the marks 
that fall in the higher half of the scale, as against agreement 
in the marks that fall in the lower half. Four or more 
markers agree forty-five times in giving grades 6-10 inclusive, 
only seven times in giving grades 0-5 inclusive, and three 
of these instances are on grade 5. From tables such as 
those given on Sheet A we may secure a statement of this 
tendency in a single figure — the coefficient of correlation 
between the average grades on all the questions in all the 
books and the corresponding average deviations of the 
markers. This figure is: r = -.401, which shows that as 
the marks descend, disagreement tends to increase. 

To the layman it is easier to see from the form of the 
questions themselves why Questions 4 and 6 should cause 
least diversity than it is to see why Questions 10 and 3 should 
cause greatest diversity; but it is the answers rather than 
the questions which must yield any further explanation of 
variation from question to question, and for such explanation 
as they may yield the whole conduct of the course must be 
taken into account. No doubt the instructors varied from 
one another in different degrees on different questions 
largely because they had different bases in experience for 
estimating what might justly be expected of any student 
on any question. 

Problem II 

How do the markers vary ? 

I. The tables used in Problem I offered some hdp in the 
solution of this second problem. 

In these tables we had each instructor's deviation from 
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the average mark on each question in each book — icx> de- 
viations for each instructor. The average of these deviations 
oflfered us an index of each instructor's tendency to vary 
from the central tendency of the group. By this index the 
instructors ranked as f ollows : 



mk 
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On the average, Instructor D varied from the central 
tendency less than one grade on a scale of ten, Instructor A 
varied considerably more than one grade. Instructor D 
agrees with the average seven times, Instructor A, four. 
Instructors E, B, and A each vary once by as much as four 
grades in a scale of ten. 

This index of variability does not show us, however, the 
actual variety of deviation in the case of any instructor — 
it fails, that is, to show for any instructor how erratic he 
was in his marking or whether he varied from the average 
by marking higher or lower. The extent and frequency 
(but not the direction) of each instructor's deviations could 
be seen, of course, by foUowing his colimm through all the 
tables. 

Some indication of these facts may also be obtained from 
Chart I, but it would be difficult to foUow the sjonbol of 
any given instructor through the several distributions. 

Chart II (below) gives us in a graphic siunmary further 
evidence on one of these points, viz., the tendency of any 
instructor to mark consistently "high" or "low," or to 
range his marks in any peculiar fashion along the scale. 
This Chart represents the distribution of all the marks 
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(100) given by each instructor, without reference to the 
question or book for which any were given. It shows, 
therefore, only a tendency to give more 4's and 5's, or more 
9's and lo's than the group as a whole — i. e., variability 
in range of grades but not in the placing of them. Thus 
this Chart shows that A tended to mark higher than the 
average, since he most often gave the mark 10, but it does 
not show whether his lo's fell with the other lo's or were 
given to quite different questions or to the same question in 
different books. 

2. A graph to show at what points, how far, and in which 
direction each instructor deviated from the central tendency 
in each of his 100 markings would necessitate a very com- 
plicated figure; hence for graphic representation of variability 
it seemed best to tum to the marks given to each book as 
a whole. These marks, of course, being aggregates, hide 
certain variations: agreement on the book may not 
indicate agreement on a single question; but variation on a 
book is a certain indication of variation on one or more 
questions and might be foUowed back to the fuller data 
given in the tables. 

The character of the variation among the markers is 
shown in several ways. (a) Sheet C shows the variation 
in the ranking of the books on the basis of the marks given 
them by the several instructors. There is full agreement 
as to the worst book — Book IV. There is practical agree- 
ment as to the ninth book, and considerable as to the eighth. 
Thereafter there is little agreement except as to the book 
for first place, Book X, on which six markers agree, the 
remaining marker putting it second. Yet for second place 
six different books are chosen. It is plain that variation 
in judgment is not inconsiderable, in spite of careful effort 
to avoid it. (b) Sheet D shows the extent of variation in 
the actual grades given to the several books. In one case 
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SHEET D — Problem II, Section 2 

The extent of variation among the marks given to each book, with graphic scheme 

to show instructors' rankings 
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(Book I) this is as much as 28 grades. The least variation 
on any book is 12 grades (Book VI); this would make a 
difference eqnivalent to a full grade on the regular Harvard 
letter-schedule of grading. Such a difference might mean 
the difference between passing and f ailure, or between honors 
and a mere pass. Under certain circumstances it might 
determine a man's fate for the A.B., or for the degree with 
distinction. 

This sheet gives us an opportunity, also, to follow a 
given instructor's markings through the series of books and 
to discover to what extent any given marker is an extremist, 
or erratic. Thus A is seen at once to be extreme in his 
gradings and a high marker: on five books he gave the 
highest grade, on two books he gave next to the highest, on 
one next to the lowest. B is ahnost as extreme as A, but 
at the other extremity. D is remarkably consistent in his 
close agreement with the median mark on each book. 
(c) Sheet E shows the position of each instructor m relation 
to the median mark on each book. The median is shown by 
the black line; to follow the deviations of a given instructor 
find his letter imder each book. This Sheet repeats the 
data of Sheet D m another form. (d) Chart III gives the 
graph of the median marks on each of the 10 books, from 
the highest down, and compares this with the graphs of 
the several instructors' marks for all the books in the same 
order. By this Chart an instructor may readily follow 
his own deviations, (e) Sheet F shows the extent to which 
each marker tends to deviate from the central judgment 
for each book. 
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SHEET E 
Problem 11, Sechon 2 

Variability of Instructors 

The marks assigned by each instructor to each of the ten books, shown in rela- 
tion to the median mark for each book 
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The Interquartile Range is taken as a zone of soiind judg- 
ment. The distance (on the scale of grades) by which any 
instructor's mark on any book falls outside this zone can 
be then seen. Thus on Book I, B's mark is 9 points outside 
the Interquartile Range, G's mark 3 points outside. The 
sum of these distances for each instructor, shown on Sheet 
G (p. 210), presents in a single figure his tendency to diflCer 
from the group. This figure gives a ranking of the instruc- 
tors as to variability on the whole series of books, which may 
be compared with their ranking as to variability on the 
questions (see above). The following table is a rearrange- 
ment of the results obtained from Sheet G. 

Outside of the Interquartile Range 

Rank Marker Number of Times Points Above Below 

1 D I I — I 

2 C 3 i8%a 3 5%a 

3 G 6 I 4% loH 

4 F 5 SH 17H — 

5 E 5 207% — 20% 

6 B 6 27H — 27H 

7 A 8 SiH 50H I 

Totals I4i%a 75% 66Via 

(f) Sheet G and the table just given show roughly the 
relation between variability in grading and the tendency 
to grade higher or lower than the group. The two most 
variable markers are sharply contrasted, A varying 50 points 
above the group to i below it, B varying altogether below. 
There is a similar contrast between F and E. G and C, who 
are not extreme in either direction, tend to vary further 
downward than upward, and if we omit the extreme case 
f umished by A, this is the tendency of the group as a whole. 
This suggests the conclusion that a severe judgment tended 
to lead to greater divergence than a lenient judgment; i. e., 
that the mood of condemnation made for inaccuracy, or 
possibly, that having decided against an answer the instnic- 
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tors saw less need for care in rating it. Chart I confirms this 
suggestion. In 38 of the icxd sqnares on the chart there is 
indicated an agreement of at least three markers and a 
divergence of at least one marker by as much as 3 points, as 
for example, in the sqnare giving the marks on Question 3, 
Book III. Studying these divergences as the extreme cases 

SHEET G 

Problem n, Sechon 2 

Diveigences outdde the Interquartile Range 
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which call for some explanation, we find that 29 of them are 
divergences downward, 17 divergences upward. There are 
six divergences of 4 points downward, three of 4 points 
upward; two of 5 points downward, one of 5 points upward. 
The total variation downward from these selected modes is 
97 points, the total upward 56 points. Divergence down- 
ward evidently tended to be greater than divergence upward. 
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The niimber of books was too few to permit any general 
answer to the question, "Does a poor book cause greater 
variation than a good one?" From what has been shown 
as to poor answers and as to severe judgments, it may be 
mferred that it does. 



II. CONCLUSIONS FROM THE StUDY OF MaRKS GiVEN IN 

ECONOMICS A 

The conclusions of faet from this study may be stated as 
f ollows : 

1. There was much diversity of marking, both on ques- 
tions and on books, in spite of eflfort to avoid it. 

2. Some markers showed a persistent tendency to mark 
either high or low; others were erratic; some varied very 
little from the central tendency. 

3. The variation on books was sufl&cient to be of grave 
consequence to the student. 

4. Poor answers caused greater diversity than good ones. 

5. Severe judgments tended to cause greater divergence 
than lenient ones. 

In so far as these conclusions hold for college marking in 
general, they may fairly be said to make clear two of its 
main requirements : first, that instructors use every means 
to reach clear agreement on standards and to steady their 
judgments in applying them; second, that they grade with 
special care answers which seem to them inadequate. 

In the general discussion which follows, the practical 
problems which these statements suggest are considered at 
some length. It is obvious that no interpretation of the 
conclusions would be safe without a broader basis of faet, 
if this study were imsupported by others of similar character. 
But the problem of marking has been studied extensively 
enough (as the references given below make evident) to 
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render it inmecessaiy to gathcr finther data in this pai^^ 
instance, althougli other studies would unqnestionably be 
worth wiiile. It gpes without saynig that there is nø inten- 
tion to inq)ly the slightest lack of effort to attain accuracy 
of n«"^fiiig in Economics A or to suggest that the saf eguards 
discussed are dther unknown to, or neglected by, the 
instructrøs in that course. This diapter of the Report is 
written in the belief that a general treatment of the problem 
of marking in college courses, based on the data presented 
above, may be of interest, and possibly of profit. 

m. General Discussiox 

An economist. Professor F. Y. Edgworth, published in 
the Journal of the Royal Statistical Sodety, in September, 
1888, one of the first thorou^ treatments of variation in the 
marking of examinations. There is a certain poetic justice 
in beginning this discussion by a citation from his paper. 
The statement to be dted sums up, in a sense, his ''human" 
conclusions, and presents at once the central problem in 
college marking. It is to the effect that there are some 
honor men who ''like the unsung brave 'who lived before 
Agamemnon,' . . . are huddled unknown amongst the 
ignominious throng, for want, not of talent, or leaming, or 
industry, or judgment, but of luck." 

This is the roet of the evil in the marking system — that 
marks are so much a matter of chance. Professor Edgworth 
proves that all mai^ — even those on large aggr^^ates — 
are as likely as not to be three per cent out of the way. 
Any mark, even under generally favorable conditions of 
marking, may deviate from the 'Hrue" mark by nine per 
cent. That is, there is a probable error of three per cent, a 
possible error of nine, in assigning a mark as representative 
of the student's real profidency. These errors are reckoned 
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"from the supposed ideal mean which would be presented 
if a large niimber of competent sets of critics were to examine 
the work." The difiference between two examiners is likely 
to be much greater; a given examiner may vary very widely 
from another who might have been in charge. (Many recent 
studies, like the one here reported, confirm this conclusion.^) 
Onr students are not wholly unjustified, therefore, in looking 
on the attainment of academic credit as a game, a gamble, 
in which merit coimts only roughly, fortime being the real 
arbiter at critical points. 

To the student who has had bad luck, there is small 
comf ort in the advice that next time he make so much greater 
effort as to raise himself beyond the possibility of dis- 
advantage from even a nine per cent error. Perhaps he has 
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already done the best he can. Nor is it much more comf ort- 
ing to assnre him that '' he is playing a game in which superior 
skill must make itself felt in the long run." His failure to get 
a "C" or a "B" may put him out of the game; or his sense 
that the game is one of chance may tempt him to try it 
again without much eSort to improve his skill, in the hope 
that next time his luck will run the other way. It is natural 
to assign to merit whatever one has achieved, to fortime 
whatever one lacks of achieving what he thinks he merited. 
Although the incertitude of marks is not the only cause, 
nor always the chief cause, of that imwholesome attitude 
toward study which is so of ten noted and deplored, it is 
unquestionably one of the causes, and one for which the 
student himself cannot be held to blame. 

Not that instructors are to blame, if they make an honest 
effort to mark justly. Safeguards against error have yet to 
be more fully devdoped and tested for general use, before 
anyone can be accused of neglect because his marking is 
somewhat at fault. The error of three per cent calculated 
by Edgworth is an error to which an imcorrected mark is 
inevitably liable, considering the frailty of hmnan nature 
and the imperfection of the data on which marks are given. 
Disagreement among instructors is natural. Increased 
divergence in the lower part of the scale is also natural, 
since an inadequate answer gives us f ewer data on which to 
base conclusions. But there is no escape from the duty of 
discovering and testing all the available methods of render- 
ing marks more accurate. 

For marking cannot be avoided, nor can the importance 
of accuracy in marking be denied. Every mark we assign is 
important, as an item in an aggregate which, for the student, 
determines success or failure. Even a low mark, on a poor 
answer, ought to be assigned with care. The question is, 
what safeguards against inaccuracy all along the line — 
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from the mark on a single examination answer to the mark in 
a course — are worth trying? 

Efforts to avoid inaccuracy may be divided into three 
classes, not imrelated nor exhaustive of the possibilities, 
but worth distinguishing : (i) eflforts to simplify the data on 
which judgments are to be passed; (2) eflforts to avoid error 
in the judgments themselves; (3) eflforts to correct error 
in the final retums. The opportunities now apparently 
open imder each of these heads will be discussed in order. 

I. Efforts to simplify our data. The prospect of securing 
standard tests in college subjects is very remote. Accom- 
plishment in a college subject is a product so complex that 
no series of simple or uniform reactions can adequately 
represent it. We cannot avoid variation by securing data 
which will permit almost mechanical grading, as we can in 
the case of elementary arithmetic; nor by using a fixed 
series of questions to which "standard" answers might be 
given. Our data, consequently, will always call for the 
exercise of judgment. 

If it were at all possible, in such a course, as Economics A, 
to work out a series of problems calling for definite and 
easily graded reactions, which might be used as a fair 
measure of accomplishment, it would of course be well 
worth while to make the attempt. If a test could be devised 
such as to give reasonable assurance that 100 per cent in 
passing it meant actual achievement of a high order, that 
50 per cent meant half that achievement, and that error 
in assigning the grade could rarely occur, we should have 
an ideal instrument of measure. To fulfill these require- 
ments, the test would have to consist of problems to which 
niunerical or very simple and definite verbal answers could 
be given; yet it would have to be comprehensive, and every 
problem would have to be so constructed that mere guess- 
work or the application of simple common sense could not 
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result in a correct solution. Obviously there is not much 
chance of securing more than a f ew sets of problems even 
approximating these specifications. If they were used as 
examinations, it would take a professional tutor a very short 
time to drill his clients into an easy "mastery" of the course. 
All that it is possible to recommend is that examination 
questions be so constructed as to favor definiteness and 
simplicity in the answers as often as may be; but it may be 
added that a test of the kind described (or anything like it) 
might be very useful and inf orming as a supplement to 
examinations or as a means of research. 

Examinations do not give us, to be sure, the only data 
on which our marks are based; but our estimates of worth 
in other cases (theses, exercises, laboratory and fidd work) 
are not less subject to error, but more. There is a fertile 
topic for exact and painstaking investigation in the question, 
How much should examinations count in the final mark, 
and how much any other sort of evidence of accomplish- 
ment? Other things equal, any piece of work which is to 
be marked ought to be presented in a form as favorable as 
possible to accurate estimate of the accomplishment it 
represents. But it is clear that we cannot mechanize the 
work we ask students to do, merely in order ;to enable us 
to mark it justly. A piece of work of the greatest value to 
a student may be the hårdest to mark; yet students pay most 
attention to work on which they are to receive grades, and 
the incentives which grading offers cannot be neglected. It 
must be admitted that the effort to simplify data for the 
sake of avoiding error in marking is not so important as the 
effort to secure data which shall signify the full character of 
the accomplishment we wish to rate. 

On this score it would seem worth while to distmguish at 
least four kinds of data: (i) answers to pure "memory 
questions"; (2) the solution of test problems set by the 
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instructor; (3) free expression on topics chosen by the 
instructor or the student; (4) constructive treatment of 
complex practicaly scientific, or literary problems. Examina- 
tions give us for the most part data of the first two kmds; 
essays, theses, laboratory exercises, and fieldwork, of the 
last two. In most college conrses, we need data of all these 
dasses in order to test accomplishment; but power can best 
be evidenced by data of the last three. It would seem 
advisable to devise as many "projects" as we can in con- 
nection with any course (that is, practical exercises involving 
the independent collection, handling, and interpreting of 
facts in the field the course covers) ; and such work ought to 
be given much weight in the final mark: yet it is not easy 
to grade. As we develop a larger number and variety of 
practical exercises to take the place of a part of the present 
lecture-text-book-test routine, we shall be increasing rather 
than diminishmg the inherent difficulty of accurate grading. 

2. Efforts to avoid error. There is the greater need, there- 
fore, of eflfort to steady and correct our judgments. If we 
could look forward to the development in college subjects 
of scales, analytical scorecards, or other objective standards, 
such as are already used to good efiect in handwriting, spell- 
ing, and certain other subjects of the elementary school, 
we might be content to do as well as we can without other 
aids imtil that royal road should be opened. But any such 
expectation must be very narrowly limited. The variety 
and complexity of work which is really to exhibit the power 
achieved in most college courses puts an objective standard 
of grading out of the question. We must f all back on means 
of rendering subjective standards more reliable. 

To this end nothing can obviate the necessity of care and 
of honesty of purpose, nor diminish the value of experience. 
If a yoimg instructor is working alone, there are not, of 
course, many opportunities for him to improve his judg- 
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ment, ezcept by reflection on his own performance, which 
is al^ays worth wlule. (For purposes of comparisoi a col- 
lection of theses, reports, and examination books illustrating 
the various grades would probably be usef ul — an inf ormal 
objective scale, which might profitably be discussed, m 
certain cases, with the students in the course.) In large 
courses, however, where several instructors mark the same 
or similar work, conferences on standards, the multiple 
reading of doubtful books, and the discussion of selected 
books and answers are available as means of acquiring 
steadiness of judgment, although such eSorts cannot of 
themselves guarantee agreement. It ought to be possible, 
also, to make the marks on the first tests in the course show 
the tendency of each instructor, so that he may take waming 
and accommodate himself to the majority judgment, as saf er 
than his own. (Probably the mode is in many cases the 
safest standard to take for this purpose, since it represents 
an actual agreement. A mode discovered on a second mark- 
ing, after full discussion, could be accepted as almost 
objective in its validity.) College instructors in general 
ought in all probability to spend more time and effort in 
the attempt to make their marking accurate; and several 
"sessions" early in the year, spent on the serious study of 
retums in test cases, might save much time later on — to 
say nothing of the contribution they might make to the 
achievement of the real aim in view. 

In anticipation of difficulties in the marking of examina- 
tions, no single safeguard is more useful than full analysis 
of the desired answers. What each answer is to contain or 
attest ought to be known in advance, and the proposed 
value of the answer in the whole book, and of each element 
in the answer, caref ully considered and discussed. The larger 
the number of elements to be taken into accoimt, the smaller 
will the error of judgment on the aggregate be hkely to be. 



MARKING 219 

The advantages of questions as tests of accomplishment 
must be balanced against possible disadvantages due to 
probable difficulty in the marking of the answers. In general, 
it may be said that the making of examinations is quite as 
difficult and important as the marking of them. 

The assignment of values to questions is in itself a special 
problem. Professor Inglis ^ suggests that values ought to be 
equated on the basis of actual performance by the students. 
A question that proves in faet twice as diflScult as another 
question ought not to have the same weight in the total; 
and on the ground that we cannot indict a whole class of 
laziness, inattention, or dulhiess, it would seem that the 
"hard^^ questions ought to count less than "easy^^ ones. 
This would mean, of course, a general raising of examination 
grades; but not necessarily the passing of more students 
nor the granting of more honor grades, since these matters 
may be otherwise controUed. 

3. Efforts to correct error. Af ter every practicable effort 
has been made to render judgments accurate, it may still 
be supposed that the final grades are subject to error. There 
remains the possibility of correction according to a theoreti- 
cally determined standard. An ideal grouping may be 
constructed to which the actual grouping shall be made to 
conform, and this procedure can be justified on the ground 
that it will result in a rating more accurate than that pro- 
vided by any given series of marks. The standard provided 
by the Probability Curve can be accepted only as a starting 
point or remote background; what is needed is a standard 
derived from a suflBiciently large munber of marks by a 
sufficiently large munber of competent critics, assigned to 
students of the same general type in the given subject. In 
default of such a standard it would seem dangerous to make 

* Inglis, A. J., "Variability of Judgments in Equating Values in Grading," 
Educaiional Administration and Supervision^ Januaiy, 1916. 
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drastic general use even of a skewed curve determined on 
purely theoretical grounds. A theoretically determined 
curve may take account of the selective influence of progress 
through school to college and may thus be available for use 
in large general courses, but it cannot be applied to marks 
in a section nor in a small or advanced course. Even a curve 
derived from several general courses does not necessarily 
fit the probable distribution of ability in a group electing 
a particiilar subject; nor can the acciunulation of marks 
over a series of years be subject to criticism if it does not 
conform to such a distribution, unless it can be shown that 
no systematic selective influence has been continuously at 
work on the group in question. A good standard distribution 
for a particular course might be f oimd in the whole series of 
marks in other subjects obtained by men electing that 
course; and such distributions might well be made at 
intervals for all the larger college courses.^ 

If a given course ought by reason of its subject or aim to 
be easier (or harder) than an average college course, some 
adjustment in the standard would have to be made; also, a 
distribution derived from marks in other courses in the same 
field might in some cases seem more useful than one derived 
from courses in other fidds. 

The disadvantage of any such standard is that it ignores, 
or rather directly coimteracts, the effect of good teaching. If 
we aim at a certain minimum accomplishment for every 
member of a course, it is a confession of failure to admit 
that any predetermined percentage of our students cannot 
possibly reach it. Our business is to correct the chance 
distribution of abiUty among them by laboring mightily with 
those who could not succeed imaided. A student aroused to 
interest by good teaching may justly complain if, after 

^ Edgworth, in the article referred to, p. 624, gives a method for correcting an 
actual series of marks by the use of a standard or ideal distribution. 



MARKING 221 

doing his best under sjmapathetic direction, he is f ailed on the 
ground that a certain number of men in the conrse ought 
theoretically to receive E's. In the last analysis the issue 
is between the instructor's estimate of accomplishment as 
it is evidenced by examinations and other data, and the 
theoretically probable accomplishment of the students he 
deals with. How much shall the deviation of his grouping 
from the normal grouping cause him to distrust his own 
judgment? The distortion of a series of marks honestly and 
carefidly given cannot be recommended as a good policy; 
yet continuous divergence from a standard distribution 
properly determined would argue either marvelous and 
improbable efficiency in teaching or an imusual and equally 
improbable selection of able students — supposing the diver- 
gence to be upwards on the scale. (A divergence downward 
would be more disturbing to the instructor as to his teaching 
and the ability of the students electing his work, more 
comforting to him as to his standards.) If neither of these 
conditions is likely (as neither usually will be), the only 
conclusion the instructor can come to is that his standard 
of accomplishment is unduly low (or high). He ought 
therefore to reexamine his standard, and make his course 
more (or less) exacting. 

It is fair, then, to say that standard distributions are 
proper instruments for the use of instructors in the whole- 
some process of critical examination of their own work, and 
that their effect ought to be apparent in the general level- 
ing of requirements in courses; but that they ought not to 
be applied indiscriminately to the correction of every set of 
marks. 

This conclusion stands in direct contrast to the con- 
clusion reached in several recent studies of college marking 
— namely, that students should be rankede not marked, 
with the corollary that the distribution of ranks should 
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conform to the normal distribution. The general procedure 
advocated is that the best performance should be given the 
highest grade and the other performances rated in order 
below it; if the distribution thus produced is not normal, it 
should then be corrected by reference to the standard 
curve. The advantage claimed for this method is that it 
avoids the inaccuracy arising from the attempt to rate a 
student's accomplishment by referring it to a supposed 
objective standard which does not in faet exist. We believe, 
however, that greater injustice and confusion will result 
from this method than from careful effort to estimate each 
individuaFs accomplishment in terms of a standard made 
as objective as possible (or defined as clearly as possible) 
by discussion, analysis of results, and comparison of grades. 
To give any student a mark which indicates only that he 
stood last, or twentieth, or first, in a class of one himdred is 
neither just nor informing. The student (and everyone 
else) inevitably takes the mark to indicate achievement in 
the subject. Unless we define how well the hundred did, it 
means nothing to say that A was first or last; and to give 
A the grade which means failure, merely because he was 
last, may work gross injustice. Vague as our standards 
may be, there is more promise of success in the effort to 
define them and apply them with care, than there is in the 
proposal that we ignore them. 

In accepting a relative standard there is, moreover, a 
subtler danger still. To be assured that an " A^' invariably 
means that a student is among the highest two or three 
per cent in his group provides, in one sense, to be sure, an 
exact meaning for the mark — but it tells us nothing about 
the actual level of achievement in the group as a whole 
and may lead us theref ore to accept as a definite estimate of 
proficiency a mark the meaning of which varies in reality 
with every instructor and every class. And when an 
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instructor knows that his marks will be considered "satis- 
factory" if they are distributed in the "normar' propor- 
tions, he may well be tempted to give up all reference to 
an "abstract" standard of achievement and hence to be 
content with whatever proficiency his instruction produces. 
Reference to an "objective" standard is salutary to student 
and instructor alike. There is no safety in marking except 
through the effort to define a standard and to mark as 
justly as may be in terms of it. The "normal distribution" 
serves best as a basis of criticism for the standard an in- 
structor has actually in mind. 

There is one possible precaution against error which our 
Harvard marking system does not favor — namely, the 
building up of the final grade from a large number of items. 
An aggregate is much less liable to error than a single 
item : hence a final grade reckoned from a nimiber of grades 
for single points (papers, exercises, examination questions) 
is more likely to be just than a grade assigned at a broad 
guess. But computation of grades means the use of nimieri- 
cal values, and we use an official scale of letters not defined 
in numerical terms. This raises the general question of the 
most advantageous mmiber of gradations in the marking 
scale. There can be no doubt that the percentage scale 
contains too many gradations for effective use: indeed, 
teachers fail to use more than the main points on the scale, 
as the clustering of their marks around the natural modes 
(the fives and tens) bears witness. But a scale with ten 
gradations is apparently quite usable; and such a scale may 
be expressed in mmibers. Using a scale of ten we may 
construct a final mark which represents an aggregate of 
single impressions rather than a single (and very general) 
impression; and when this aggregate covers a considerable 
mmiber of items the chances of error are much reduced. 

Against this procedure it may be urged that the grouping 
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of students into five main classes (A's, B's, etc), with due 
regard to the conf ormity of our grouping to the ideal group- 
ing, is more likely to avoid error than is any other method. 
It is true that broad distinctions are easier to make; and final 
rating in terms of such distinctions is therefore desirable. 
But in the doubtful and border-line cases ("high C" men, 
"low C" men, et al.) we are thrown back on some method 
of checking up our estimates. Chu: distribution may con- 
form in general to the ideal grouping, but who shaU tell 
whether we have dealt justly with the individuals thus 
grouped? 

Accuracy in marking of ten demands the combination of 
separate items, the computation of an aggregate from 
weighted parts, and other calculations; and this demand 
cannot be fidfilled if we use only relative ranks eicpressed 
by letters. 

In the end it must be recognized that there is no short 
cut to justice in marking. Care and effort are essential 
everywhere. Fundamental in the whole business is the 
necessity of organization in the work of the course itself : 
the fitting of requirements to the limitations of the student's 
time and to his stage of advancement; the most advantageous 
balance in the assignment of reading, conferencés, papers, 
practical exercises, and other work; the best arrangements 
for guidance and the greatest explicitness of instructions 
without loss of initiative to the student. Our courses need 
a measure of administrative standardization, which need 
not mean in any sense mechanization. Definiteness as to 
the demands which a college course may reasonably make 
on a student's time and effort is the best basis for every 
attempt toward accuracy in the grading of his work. 



CHAPTER VIII 
Summary of Conclusions and Recommendations 

This chapter brings together in a series of bripf statements 
the more important conclusions and recommendations of the 
Report. These have been arranged by groups in the order 
of their general importance; that is, the conclusions and 
recommendations we consider fimdamental have been pre- 
sented first and in a separate group, other tindings and sug- 
gestions, even though they may be of more immediate prac- 
tical interest, being grouped thereaf ter under special heads. 
These statements are all subject to the qualification men- 
tioned on page 6; and we smnmarize them here not in order 
to insist on each in tum, but in order to bring them into rela- 
tion to each other and to promote convenience of reference. 
It seemed desirable thus to present the major results of the 
Inspection in a grouping indicative of our own interpretation 
of their relative significance. The mmibers in parenthesis 
refer to pages on which the various conclusions and recom- 
mendations are stated or discussed, or on which facts in 
support of them are given. Evidence and argument from 
scattered portions of the Report are thus combined to show 
what seems to us their logicai bearing. 

I. Conclusions and Recommendations of General 

Importance 

A . Concerning the Study and Regidation of Instruction 

Undergraduate teaching should be subject to fuller de- 

partmental discussion and supervision (lo, 13, 17, 18, 174, 

325 
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178, 190). The problems of teaching should be given more 
direct and objective study (4, 9, 10, 15, 88, 95, 96, loi, 178, 
190). The normal amomit of teaching should be reckoned 
more exactly and the importance of teaching be given f idler 
recognition (10, 14, 15, 88, 190). 

B. Concerning the Aims and Organization of Courses 

The aims of conrses should be more clearly defined (17, 25, 
171, 173, 174) and students made more fuUy aware of them 
(i 50, 1 70) . The predominantly practical pmposes of a large 
majority of the students (28, 113, 115, 147, 148, 149) should 
be recognized in the organization of curricula (10, 13, 21, 22, 
26, 31, 32, 33, 34, I3S, IS9, 160, 174). 

C. Concerning the Effectiveness of Instruction 

Instruction should be more closely adapted to the pmposes 
and needs of the students (10, 12, 13, 87, 151, 152, 161, 162, 
166, 176, 177, 189, 192, 197, 211, 224). Personal contact 
between professors and students should be more frequent 
(14, 114, 116, 136, 152, 162, 164, 180, 189, 190). FuUer 
guidance in the choice of courses (116, 150, 174) and in meth- 
ods of study (13, 14, 87, 165, 192) is desirable. Occasions for 
participation in class and for reaction on lectures and reading 
should be more frequent (114, 162, 180, 191). Teaching 
should have fuUer reference to contemporary afifairs and the 
work of students should provide more frequent occasion for 
direct and personal contact with them (10, 26, 83, 115, 116, 
139, 140, 151, 161, 162, 166, 173, 180, 194). 

II. CONCLUSIONS AND ReCOMMENDATIONS ON SpECIAL 

Topics 

A. Concerning the Relation of Economics to Other Subjects 

The relations between ranking in Economics courses and 
ranking in courses in any other subject do not justify 
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special recommendations (35, 39, 56). As compared with 
the "typical" Harvard correlation coefficient of 50 per cent, 
the correlations of Economics A with Mathematics C and 
with Government i are fairly high; other correlations of 
Economics A are low (52, 57, 58, 59). Government i seems 
to have the closest relation to Economics A and Government 
in general to Economics (35, 37, 58, 150). Interpretations 
of correlation coefficients should be made with caution (55, 
56, 64, 65, 66) ; but correlations between Economics marks 
and admission marks support the belief that admission ex- 
aminations are poor tests of ability (60, 67, 70). 

B. Concerning the Relations of Economics Courses to Each 

Other 

Standing in Economics A does not materially affect the 
election of advanced instruction in Economics (44, 45); 
and although men of high rank in Economics A are much 
more likely to go on to strictly graduate work (44, 46, 50), 
men of low rank may do well in middle-group courses 
(50). There are marked differences in the abilities of the 
groups electing the several advanced courses (50, 51, 57); 
and in the grading of advanced students there is some arbi- 
trary and avoidable shifting of marks (49, 50, 63). 

C. Concerning Marking 

Neither the standard distribution of marks for the De- 
partment (40) nor the "Probability Curve" (42, 219 ff.) 
can be taken as a final basis of criticism for course distri- 
butions (40, 42, 57). An agreement (mode) is a better basis 
than an average or median (40, 218). Standards at mid-years 
and at finals should be the same (41). College marking is at 
best far too much a matter of chance (197, 202, 203, 206, 
213) and every care is needed to make it accurate. (215 ff.) 
Poor answers in examination books are hårdest to grade, and 
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severe judgments most likdy to be erratic (200, 201, 209, 
2 10) . The ranking of students and the assignment of grades 
in fixed proportions according to a standard distribution is 
to be condenmed. (219 ff.) 

D. Concerning Details of Instruction 

There is great dissatisfaction with assistants and with 
sections; sections should be given up wherever possible 
(115, 136, 161, 162, 164, 179, 190). Class discussion as a 
method is favored by a number of graduates (114), and 
greater care in the assignment, coordination, and fadl- 
itation of reading is desired (151, 152, 161, 162, 166). 
Memory work is not imduly stressed (106), but devices 
for sharpening interest could well be multipKed (92, 93, 94, 
106). Graduates, advanced students, and students of high 
standing profit most from lectures; other students get more 
from other phases of their work (114, 154, 157). 

E. Concerning the Students 

The purposes of the students are primarily practical, 
either vocational or social (149, 159, 160), and curricula 
should be f ramed to meet their need of practical training 
(31-34). They choose courses largely on their reputation 
(150, 174) and are but Uttle able to distinguish the specific 
values of the instruction they receive (150, 159, 170). In 
their study they have in mind primarily the requirements 
of courses (87) ; and they need guidance in methods of work 
(87, 88); but they are interested in many contemporary 
problems (160). Young students are at no disadvantage in 
Economics courses (71). 



SUPPLEMENTS 
I. A List of Problems for Investigation 

I. The student body. 
I. Preparation. 

(a) Åre students admitted to any course too young to 
profit by the work? 

Study age and rank corrdations in Economics i 
and perhaps other courses. 

Ought the department to restrict admission to 

its courses by age or dass? 

(b) Are students who have taken History or Civics in 
high school or History or Government in college 
at any advantage over other students in Eco- 
nomics A? 

Study rank in Economics A of students who 
have passed in advanced admission History, 
Economics, or Government; also rank of those 
who have had History I, Government I, or both 
in college. Use test questions in Economics A. 
Ought the Department to require any prep- 
aration courses for Economics A? 

(c) What requirement of courses in Economics, His- 
tory, or Government, or other subjects should be 
made of students admitted to advanced Eco- 
nomic courses? 

Study ranks, give tests in dass, inspect students' 

lecture notes, teachers' syllabi. 
What sequences of courses ought the Depart- 
ment to insist on? 

(d) What is the initial equipment of students in the 
Department? in knowledge of economic data 
and problems? in power to deal with economic 
questions? 

Test questions in Economics A. 

Ought the Department to have a standard 

test of this sort? What suggestions for the 

elementary course does it yield? 
339 
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2. Conditions of study. 

(a) Åre thesis work, reading, and fiddwork economi- 
cally distributed? 
Study inddence of assignments — amounts of 
readkig to be done, theses, etc. in individnal 
cases. 
Ought the Department to make more careful 
rules as to assignments? What is the normal 
amount of reading and thesis work for an 
imdergradnate course? 

3. Personal aims. 

(a) Åre students sdecting Economics courses intelli- 
gently and purposefully? 
Questionnaire as to personal aims, and the value 
of instruction in subserving them. 
What data as to personal aims ought in- 
structors to have and what accoimt ought 
they to take of such data? What advice as 
to sdection of courses is needed? How should 
courses be advertised? 

(6) Åre students attempting to secure the degree with 

distinction with full understanding of its value? 

Questionnaire — statistics as to numbers tak- 

ing degree, failures, etc. 

Should any changes in the conditions, an- 

noimcements, or management of the degree 

be made? 

(c) Is concentration in the Department intelligent 
and purposeful? 

Questionnaire — statistics — facts conceming 
advice given, conferences with instructors, etc. 
Ought the Department to guide more care- 
fully students who concentrate? 

(d) Is candidacy for the Ph.D imdertaken with ade- 
quate information conceming the values of the 
degree and of the work for it, and with dear aims? 

Study of careers of former candidates — ques- 
tionnaire — study of thesis subjects — statistics. 
Ought the Department to differentiate its 
work for the Doctorate or dissuade any from 
attempting it? 
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4. Social demands. 

(a) Does the instruction in the Department meet the 
needs of gradnates for economic information and 
insight? 
Questionnaire to graduates and business men 
in general, economists, and officials. Test ques- 
tions to students, especially to students who 
have taken only Economics A and are now in 
Senior Year or in a Graduate School. 
What practical needs ought instruction, es- 
pecially in Economics A, to meet? 

5. Capacity and achievement. 

(a) What are the factors in the problem presented by 
the D and E men? 
Study individual cases to determine causes of 
failure and poor work. 
Ought the Department to keep more careful 
and more readily available records of stu- 
dents' work and regulate admission to courses 
in the light of such records? 

(6) What can be done to make more effective the work 
of high-grade men? 
Questionnaire as to aims of A and B men and 
the relations of their work in Economics and in 
other Departments. 
Ought the Department to imdertake more 
careful guidance of the work done by high- 
grade men? 

II. The instruction. 

1. Aims. 

(a) Are the aims of the courses and groups of courses 
adequately defined? 
Study pamphlet, talk with instructors and stu- 
dents, consult economists. 
Ought the Department to define the aims of 
its work more clearly or on a new basis? 
How should it advertise the work? 

2. Scope. 

(a) What portions of the economic field are not cov- 
ered by the instruction, if any? 
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Co5peratioii of economists. Study of instruc- 
tion oflfered in other universities. 
Ought the Department to expand its work? 

(b) Does the instruction provide adequate training in 
the more important methods of economic investi- 
gation and economic thought? 
Co5peration of economists. Study of other 
universities. Inquiry of instructors. 
Ought the Department to cover Economic 
Methods in a separate course, or otherwise? 

3. Organization. 

(a) Is the work so distributed that it meets best the 
needs of the students? 

Study enroUment in courses. Question stu- 
dents and instructors. Cooperation of eco- 
nomists, business men, govemment officials. 

Ought the Department to strengthen certain 

fidds? 

(b) Is the work so organized that there is a minimum 
of duplication of effort? 

Study students' and instructors' lecture notes 
— terminology — topics. 

Ought the Department to agree upon terms 
and the treatment of topics? 

(c) Is the work organized so as to bring the students 
and instructors into touch with the economic 
forces and agendes in the outside worid? 

Study plans of work in courses, conferences, 
etc, and non-instructional activities of the De- 
partment. Cooperation with economists. Other 
imiversities. 
Ought the Department to plan for more defi- 
nite contact with the economic world? 

(d) Is the work so organized as to enable students to 
acquire insight in the fidd as a whole and power 
in spedal fieids? 

Study correlation of courses, actual curricula, 

fidds of theées for degrees with distinction, Ph.D. 

candidates, etc. 

Ought the Department to open new possi- 

bilities of spedalization, and new opportimity 

for coordination of courses in groups? 
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{é) Is the work so organized as to make full use of the 
students' rdated work? 

Study correlation of courses in History, Gov- 
ernment, Social Ethics, Education, Anthropol- 
ogy, as to hours, periods of history, etc. 
Ought the Department to plan more directly 
for correlation? 

{f) Is the work so organized as to minimize the dis- 

advantages of large courses? 

Study the work of conference and section as- 

sistants. What are the variations of method, 

marking, hours, and results among sections? 

Question students and instructors. Apply tests. 

Ought the Department to divide large courses 

into smaller courses or use administration 

measures for further control and improve- 

ment of the work done in large courses? 

4. Administration. 

(a) Is there an adequate system of administrative 
control of instruction? 
Study the provisions for administrative con- 
trol by consultation with members of the De- 
partment. Study the plan of administration in 
other universities. 
Ought the Department to devise a more com- 
plete system of administrative control and 
assign the work to members relieved from 
instruction for that purpose? 

(J) Is the marking system eflFectively used? 

Tests to determine subjective variations of 
standard. Curves of marks in courses to deter- 
mine range of marking. Questionnaire as to 
aims in the use of marks. 
Ought the members of the Department to 
agree more definitely as to bases for marking 
and the use of marks? 

(c) Are examinations in the several courses effec- 
tively used? 
Study the examiLation questions: Do they test 
the student's knowledge? Do they permit in- 
structors to grade students on examinations 
justly? 
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Ought the Department to agree upon methods 
of examination and the use of examinations 
as tests and as educative exercises? Is there 
a possibility of agreeing upon the weight ex- 
aminations ought to have in the make-up of 
the final mark for a coiirse? 

{d) Is it possible to devise and apply a standard 
measure of progress in capacity to handle eco- 
nomic data and solve economic problems? 
Get the cooperation of the instructors of the 
Department and of economists outside the 
imiversity in devising a series of test questions 
which can be applied from year to year to show 
progress in general grasp of economics. 
Ought the Department to test students who 
concentrate in economics and determine in a 
general way the progress they are making 
from year to year? 
5. Method. 

(a) Is inductive presentation possible and fruitful in 
particular courses? 
Experiment with inductive and deductive pres- 
entation. 
Ought instructors to resort as often as possi- 
ble to inductive procedure? 

{b) Is it possible to teach economics through the ac- 
tivity of the students themselves in gathering eco- 
nomic data, attempting economic generalizations, 
and facing economic problems? To what extent 
can actual economic investigation be used as a 
means of instruction, in the place of reading and 
abstract discussion? 
Experiment with student activity as a means of 
instruction. 
Ought the Department to organize more op- 
portunities for laboratory and field work? 

(c) Is the leaming of economic facts and principles 
properly conducted and adequately tested by 
instructors? 
What are the kinds of data instructors think 
necessary to be leamed? Is there any attempt 
to guide the students in the memorizing of this 
material? Are tests and discussions suffidently 
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frequent to give ample opportiinity for recall 
and application of the material? 
Ought the instnictors to make a doser study 
of the presentation of those parts of their 
material which they expect students to retain 
exactly in mind? 
III. Thestaff. 

1. Size. 

(a) Is the staff adequate for the work to be done? Is 
the work properly distributed? 
Personal data from instnictors. Inquiries among 
students conceming value of conferences with 
assistants. 
Ought the Department to try to secure more 
men, or more men of a given rank? 

2. Selection. 

(a) What is the method of nomination of new mem- 
bers of the staff and what are the recognized re- 
quirements for appointment? Is there any differ- 
entiation of requirements for different kinds of 
work, such as emphasis on teaching power for 
work in Economics A? 

Inquiry and general discussion. 
Ought the Department to adopt a more 
clearly defined policy in the selection of 
teachers? 

3. Organization. 

(a) Is the organization of the staff suffidently defi- 
nite, so that responsibility for the achievement of 
spedfic aims rests dearly on individuals? 
Inquiry among members of the staff and general 
discussion. 
Ought the Department to group courses for 
more definitely educational purposes, and 
cjivide responsibility for the accomplishment 
of them? 

4. Diverting interests. 

(a) What outside work do members of the staff un- 
dertake and what relations do such tasks bear to 
the work of instruction? 
Personal inquiry among members of the staff. 
Ought the Department to define more dearly 
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the duties which may properly be under- 
taken as professional activity by members of 
the staff and arrange instruction accordingly? 

IV. Equipment and resources. 

(a) What does instruction in Economics cost, as a 
whole, and by courses, both absolutely and in 
comparison with other subjects? Is the cost 
reasonable, considering the residts? 

n. Theses in College Courses 

The writing of theses in college courses — how many 
are required, of what length, at what times, of what value 
to the student, imder what standards of content and of 
form — may be pictured in some detail from the replies to a 
questionnaire sent to Seniors in Jime, 1914, by the Conmiit- 
tee on the improvement of students' English. This study was 
made by a member of the Division of Education serving on 
the Committee and is here for the first time reported in full. 

The questionnaire read as follows: 

In accordance with the request of the Board of Overseers, a Com- 
mittee has be^ appointed to suggest methods of improving the qual- 
ity of English written'by students in college. The Committee will 
be greatly obliged to you if you will fill out this blank and mail it at 
once in endosed envelope. Please do this with as much accuracy as 
possible, and wUhotU dday. 

CHARLES H. GRANDGENT, CAairwan. 

Date when 

•tttdent was in- 

f onned o< thesis 

Length xequiiement Date whea 

Subiectof (inwMds and thesbwat 

Coufse Thesii arøroziiiiatdy) subject handedia 

1. Name of student: 

2. Theses written in 
1913-14. 

3. Other larger pieces 
of written work 
(not including 
those in courses 
in English Com- 
position) 
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4. How far were your theses (and other like tasks) marshalled con- 
veniently, how far did they come due at dates inconveniently near 
each other? 

5. Were you notified that the English used, the style and arrangement, 
were of importance? 

6. How much attention did you actually pay to these matters? 

7. Remarks and suggestions: 

Four himdred and twenty-two blanks were sent out and 
ninety-four replies received. The following table shows 
the number of theses and "other larger pieces" written 
during 1913-14 by the ninety-four students who replied. 



Total number of students 
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Number having no 
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- 13 
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* I 
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« I 


« 1 


* 10 
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* II 
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« 1 


* 12 
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« I 
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* 13 
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Some students evidently suflfer from a "congestion" of 
thesis requirements — not so many as to make this dis- 
advantage an excuse for general laxity in students' English, 
but enough to make it apparent that instructors should use 
care in assignments. 

The following table shows the " thesis-economy " of these 
students from another angle. It presents what may be 
cailed the " total- word-bur den " of thesis writers during an 
academic year. 



Students writing in all not more thui 5000 words 

" " " " between 5000 and 10,000 words 

10,000 15,000 

" 15,000 " 20,000 " 



tt 
tt 



tt 
tt 



tt tt 



17 

17 
II 

II 
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Students writing in all between 30,000 and 25,000 words — 6 

— 3 

— 3 

— o 

— I 

— 3 

— 3 

— 21 



(I 
(I 
« 

tt 

u 



tt tt t 


* " 35,000 " 30/x>o " 


tt tt t 


* " 30,000 " 35,000 " 


tt tt t 


* " SSfOOo " 40,000 " 


tt tt t 


* " 40,000 " 45,000 " 


tt tt t 


' " 4S/>oo " 50,000 " 


tt tt t 


* 50,000 or more woids 



Students writing no theses 

A f ew students evidently have to write far too much in the 
course of a college year — not so many, again, as to 
account for generally poor English in the College, but 
enough to make clear the need of care in managing 
assignments. 

The average length of theses, in words, is 8079 ; of " other 
large pieces," 3626. 

The f ollowing table shows how the theses were marshalled 
throughout the year — that is, it shows how many students 
were writing at a certain rate in any given month: e. g., in 
March, five students were writing at the rate of 20,000 to 
40,000 words. 



Number of students writing at various rates (in hundreds of words) in the 

several months of the Academic Year 
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November 
December 
January . 
February 
March . . 
April . . 
May . . 
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Some students are plainly "rushed" in their thesis work. 
The testimony of the replies shows that 54 men found their 
theses conveniently marshalled and 17 foxmd them incon- 
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veniently marshalled. Twenty-three gave no testimony on 
this point. 

The average length of time for the preparation of a thesis 
was two and three-fif ths months — a fair period for a thesis 
of reasonable length, if the materials are available without 
prolonged search and if they are not nndnly difficnlt to 
assemble and present. 

Thirty-fonr men were notified that " the English used, the 
style and arrangement, were of importance"; forty-nine were 
not so notified; eleven made no answer on this point. 
Twenty-eight paid considerable attention to English; forty- 
six paid little attention to it; six none., Twelve made no 
statement conceming their efifort to write well and two 
answers were doubtfnl. Neither instructors nor students 
pay enough attention to the English nsed in theses. 

Special mention of theses in Economics courses occurs 
in some replies and is implied in others. The trend of this 
testimony may best be seen from the f oUowing quotations : 

Paper No. i. Economics courses in which theses were 
written: 4a, 6a, 2b, 4b. 

"In the Economic courses I paid very little attention to English, 
mostly because I did not have time and it was not required, and 
secondly, because I felt that my instructor did not know much 
more English than I did. This is not in praise of myself , but more 
a critidsm of the instructor. If there had been more room on the 
paper I could have told you more. I feel very strongly against the 
present young instructor at Harvard. Of course they get the best 
for the money that is given for that purpose, but I have seen too 
many that do not imderstand yoimg men and are very hard to 
approach." 

Paper No. 5. Economics courses, etc: 4a9 b4. 

"The whole system of assigning work seems rather slipshod. 
When work is arranged conveniently it is rather by chance than by 
any systematic plan." 
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Paper No. 6. Economics courses : 4a. 

''My only suggestion would be to annoimce the subject of the 
thesis at the beginning of the year and let the student who has 
more than one choose his own time for doing it before mid-year; 
also put a slight requirement on good English." 

Paper No. 15. Economics courses: 4a, 9, 33. 

''No particular emphasis was placed on these qualities, although 
all insisted upon bibliographies, and in some cases, critical bibliog- 
raphies." 

''Although theses are very valuable in most courses, I think 
there can be too much of a good thing. Life for me this year has 
been one thesis af ter another — ' with a little profanity thrown in.' " 

Paper No. 23. Economics courses: 4a, 

"If advice in conferences on theses was not limited to scope 
and sources but induded also a detailed consideration of arrange- 
ment of material, a gain in deamess, if nothing else, woidd residt.'' 

Paper No. 25. Economics courses: 4a, 4b. 

" Reports sudi as those in Economics 4a and 4b have to contain 
many statistics and are not weU adapted to literary style." 

Paper No. 27. Economics courses: 33. 

"Only in the Economics 33, for distinction, was mudi atten- 
tion to such given." 

"Conceming pure research, in many coiirses, too much em- 
phasis shoidd not be placed on the English and style, for the stu- 
dent may have but a poor store at his command, and yet prepare 
a valuable work." 



III. Age and Scholarship 

The general relation between age, scholarship, and 
academic discipline is shown by the following quotations 
and charts from an article in the Harvard Graduates' 
Magazine for June, 1913. 

The facts which are used in this study were gathered from the 
college records of 5769 students — all the "regular" Freshmen en- 
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tering in the classes from 1902 to 191 2 indusive — that is, all the 
students in these classes except those who entered as "special" stu- 
dents, or as "unclassified" students, or as students admitted from 
other colleges. £ach record was classified, according to the student's 
age at entrance, to show whether he had been (i) admonished, (2) on 
probation once, (3) on probation more than once, (4) visited with 
severer disdpline (such as suspension), or (5) expelled permanently. 
The cases of students who left "for other than disciplinary reasons" 
were separately recorded. Also, the cases of students who achieved 
the degree cum laude or better, were separately recorded. The rest 
were dassified (with no disparagement to their daims for distinction 
on other groimds) as students "of no record." The dassification was 
in faet much more complicated than this, distinguishing disdpline 
"for low rank" and "for conduct" and dividing the records in other 
ways; but for present purposes the groupings just named are most 
significant. 

The simimarized results of this labor are simple and striking. Of 
the total mmiber of students entering at each age from 15 to 22, they 
show what proportion got into "trouble" of any sort with the Col- 
lege OflSce, what proportion achieved at least the lowest form of 
regular academic commendation at Commencement, and what pro- 
portion escaped both disdpline and distinction. The three curves 
plotted on the following chart present these facts in graphic form. 

The points in these cvirves indicate, of course, percentages. Thus, 
of the total number who entered at 18, 39.40 per cent were at least 
admonished by the College Office, whidi is shown by a point on the 
black curve of "wickedness"; 40.69 per cent were "of no record," 
which is shown by a point on the dotted curve of "inoflfensiveness"; 
and 19.80 per cent graduated cum Umde or better, which is shown by 
a point on the broken cvirve of scholarship. 

Af ter accuracy in compilation, the importance of statistics depends 
on the number of cases recorded. Because the group that entered 
at 15 shows the highest percentage of scholarship and the lowest per- 
centage of "wickedness" we can by no means safely conclude that 
fif teen-year-old boys would be the best population we could get for a 
Freshman dormitory. There are only 19 cases in the whole group. 
The sixteen-year-old boy group is larger, but still too small for safe 
condusions — 218 cases. The groups entering at 20 and over are 
also small. But the groups recorded between the two heavy vertical 
lines — the seventeen, eighteen, and nineteen-year-old groups — are 
all large and not too widely disproportionate: 1102 cases at 17, 1981 
cases at 18, 1394 cases at 19. These numbers are great enough to 
give us a fair basis for argument. The continuous rise in the "wick- 
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edness" curve, and the ctmtinuous drop in the scholarship curve, 
canying across the lines for these three big groups, show a real ten- 
dency, on which we may rely. 

Tbis tendency is clearly in favor of youth. The C4>lkie gets beUer 
aoerage resuUs, wUh Uss frictum, from younger men than from older 
men. Possibly this faet may be shown more clearly by a chart of 
columns representlng actual numbers than by a chait of curves rep- 
lesenting percentages. See Chart II. 

CHART ra. 




Here the three groups of columns represent together all the stu- 
dents admitted at the ages really in question — 17, 18, and 19. The 
numbers for these ages do not vary so markedly as to hide the true 
proportions of the ctJumns in each group — the black column for 
college "sinners," the wbite column for college "common folks," the 
shaded column for college "saints." If Dean Hiirlbut and Mr. Cram 
could meet (say in the Yard at the opening of the year) three groups 
of entering students prophetically divided as these columns indicate, 
there would be small doubt as to which group they would welcome 
most heartily to Harvard College. 
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Now it may seem that in all this there is too much "lumping" of 
results. "Trouble" means anything, from admonition — a simple 
waming from the guardian of college morals — to complete dis- 
inheritance by a mortally oSended Alma Mater. Ttiis might obscure 
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such differences in the tendencies of "youth" and "age" to give con- 
cem to the Administrative Board as would really vitiate conclusuons 
about the relative burden of transgression amoi^ young men and old. 
Perhaps among older students "a word to the wise is sufficient," 
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whereas among younger ones hot heads cannot be restrained with 
wamings. As a faet, the exact opposite is the case. Chart III shows 
"wickedness" analyzed into its several categories. The proportion 
of students of a given entrance-age who finally reach any circle of this 
Inferno can be f oimd by noting the point where each curve crosses the 
line for that age. 

The significant thing about this chart is the point, marked by an 
appropriate star, at which f alls the largest percentage of students re- 
ceiving each particular kind of college censure. Among the yoimger 
students the proportion content with the milder college punishments 
is large; as we go up the ages the severer penalties claim a greater share. 
Quite a different result would not have been surprising. 

Scholarship, analys^ed, shows an analogous residt. The yoimger 
men have an advantage over the older, except that the oldest — those 
who entered at 22 and over — show some superiority when compared 
with those who entered a year or two earlier. The curve for the magna 
cum Umde men is slightly irregular; but the chart as a whole shows the 
same relation of age to Uie several grades of scholarships as is indicated 
by the curve for the "lumped" result, in Chart I. It is not especially 
surprising, of course, that the yoimger men, up to a certain age, are 
better students, on the average, than their older classmates. But it is 
worth noting that the superiority of the yoimger men persists, through 
the three important ages, for every grade of scholarship. See Chart IV. 
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V. A List of Documents and Materials Used in 

COURSE OF THE InSPECTION 

1. Pamphlets of the Division of History, Government, and Eco- 
nomics, 1912-13, 1913-14, 1914-15, 1915-16. 

2. Report of the Committee appointed by the Department of 
Economics to consider Courses of Instruction. 

3. Votes passed by the Department of Economics conceming 
courses. 

4. Outline of a Plan for a General Final Examination in the 
Division of History, Government, and Economics. 

5. Division Examinations for the Degree of A.B., 1915-16. 

6. Schedule of courses in approved specific fieids of concentra- 
tion within the Department of Economics. 

7. Letter from Professor Bullock, March 7, 1913, conceming 
guidance given to students by members of the Department. 

8. Letter from Professor Bullock, November 10, 1914, concem- 
ing coordination of courses in the Department. 

9. Report of Mr. John Wells Morss of the Visiting Committee 
for the Department conceming section meetings in Economics A. 

10. Statement by the Conmiittees on Practical Training appointed 
by the American Political Science Association and The American 
Economic Association. 

11. Preliminary Report of the Conmoiittee on Practical Training, 
American Political Science Association, Proceedings 19 13-14. 

12. Questionnaire on Field Work issued by the American Associa- 
tion of Urban Universities. 

13. Article on Sequence of Courses in Economics at the University 
of Chicago, Journal of Political Economy, Vol. XXI, No. i, Leon C. 
Marshall. 

14. Article on the College of Conmoierce and Administration of the 
University of Chicago, Journal of Political Economy, Vol. XXI, No. 2, 
Leon C. Marshall. 

15. Survey Smnmary, University of Wisconsin Svirvey. 

16. Comment of the University CoDMnittee on the Survey Sum- 
mary. 

17. Miami University Bulletin, Series XI, No. 10. 

18. Bulletin of the Massachusetts Institute of Technology, Vol. 
46, No. 2. 

19. EflSciency Measurement in College, Harvard Alumni Bulletin, 
Vol. XVI, No. 8, President Lowell. 
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20. College Studies and Professional Training, Educational RmeWy 
Vol. 42, No. 3, President Lowell. 

21. Tests of College Effidency, Report of a Spedal Committee of 
the Oberlin College Faculty, 190&-9. 

22. Academic and Industrial Effidency, Bulletin No. 5, The Car- 
negie Foimdation for the Advancement of Teadiing, 1910. 

. 23. Sdiool and University Grades, Bulletin of the University of 
Wisconsin, No. 368, Walter F. Dearbom. 

24. The Rdative Standing of Pupils in the High Sdiools and in 
the University, Bulletin of the University of Wisconsin, No. 312, 
Walter F. Dearbom. 

25. Sdentific Grading of College Students, University of Pitts- 
burgh Bulletin, Vol. 8, No. 21, Ra)anond W. Sies. 

26. Sdentific vs. Personal Distribution of College Credits, Popular 
Science MatUhlyf April, 191 1, President William T. Foster. 
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